Jun 01 01:35:08 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 01 01:35:08 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 01 01:35:08 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 01 01:35:09 devstack cinder-volume[75826]: INFO dbcounter [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Registered counter for database cinder
Jun 01 01:35:09 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:35:09 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writer thread running {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 01 01:35:09 devstack cinder-volume[75826]: INFO cinder.rpc [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 01 01:35:09 devstack cinder-volume[75826]: INFO cinder.rpc [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 01 01:35:09 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:35:09 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Determined volume DB was empty at startup.
Jun 01 01:35:09 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75826) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 01 01:35:09 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 01 01:35:09 devstack cinder-volume[75826]: WARNING stevedore.named [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 01 01:35:09 devstack cinder-volume[75826]: WARNING castellan.key_manager [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 01 01:35:09 devstack cinder-volume[75826]: WARNING cinder.keymgr.conf_key_mgr [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 01 01:35:09 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75826) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 01 01:35:09 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] CMD "cinder-rtstool verify" returned: 0 in 0.349s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:35:10 devstack cinder-volume[75826]: INFO cinder.rpc [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 01 01:35:10 devstack cinder-volume[75826]: INFO cinder.rpc [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 01 01:35:10 devstack cinder-volume[75826]: WARNING stevedore.named [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 01 01:35:10 devstack cinder-volume[75826]: WARNING castellan.key_manager [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 01 01:35:10 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:35:10 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Starting 1 workers
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Started child 75998 {{(pid=75826) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Full set of CONF: {{(pid=75826) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Configuration options gathered from: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] ================================================================================ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] allow_availability_zone_fallback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] allow_compression_on_image_upload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] allowed_direct_url_schemes     = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] api_rate_limit                 = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] auth_strategy                  = keystone {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] az_cache_duration              = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_availability_zone      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_host                   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_name                   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_stats_polling_interval = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backup_api_class               = cinder.backup.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75998]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backup_name_template           = backup-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backup_use_same_host           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backup_use_temp_snapshot       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] chap_password                  = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] chap_username                  =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_internal_tenant_project_id = 2454f5f529d04f539c26db7f674ad9c1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_internal_tenant_user_id = 48f932cfe65c4d26b92e949bdfe60615 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cloned_volume_same_az          = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cluster                        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] compression_format             = gzip {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] config_dir                     = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] config_source                  = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] control_exchange               = openstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] debug                          = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] default_availability_zone      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] default_group_type             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] default_volume_type            = lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] disk_geometry                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] driver_client_cert             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] driver_client_cert_key         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] driver_data_namespace          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] driver_ssl_cert_path           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] driver_ssl_cert_verify         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] driver_use_ssl                 = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] enable_force_upload            = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] enable_new_services            = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] enable_unsupported_driver      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] enforce_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] filter_function                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_api_insecure            = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_api_servers             = ['http://192.168.122.157/image'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_api_ssl_compression     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_ca_certificates_file    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_certfile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_keyfile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_num_retries             = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance_request_timeout         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] goodness_function              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] graceful_shutdown_timeout      = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] group_api_class                = cinder.group.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] host                           = devstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_compress_on_upload       = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_conversion_address_space_limit = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_conversion_cpu_limit     = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_conversion_disable       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_upload_use_cinder_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_upload_use_internal_tenant = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_volume_cache_enabled     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_volume_cache_max_count   = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] image_volume_cache_max_size_gb = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] init_host_max_objects_retrieval = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] iscsi_target_flags             =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] iscsi_write_cache              = on {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] iser_helper                    = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] iser_ip_address                = 192.168.122.157 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] iser_port                      = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_color                      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_config_append              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_dir                        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_file                       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_options                    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_rotate_interval            = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_rotate_interval_type       = days {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] log_rotation_type              = none {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] max_age                        = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] max_logfile_count              = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] max_logfile_size_mb            = 200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] max_over_subscription_ratio    = 20.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] message_reap_interval          = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] message_ttl                    = 2592000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] migration_create_volume_timeout_secs = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] monkey_patch                   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] monkey_patch_modules           = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] my_ip                          = 192.168.122.157 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] no_snapshot_gb_quota           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] num_iser_scan_tries            = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] num_shell_tries                = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] num_volume_device_scan_tries   = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] nvmeof_conn_info_version       = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] nvmet_ns_id                    = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] nvmet_port_id                  = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] osapi_max_limit                = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] osapi_volume_ext_list          = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] osapi_volume_listen_port       = 8776 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] osapi_volume_use_ssl           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] osapi_volume_workers           = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] per_volume_size_limit          = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] periodic_fuzzy_delay           = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] periodic_interval              = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] public_endpoint                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] publish_errors                 = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] quota_backup_gigabytes         = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] quota_backups                  = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] quota_gigabytes                = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] quota_groups                   = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] quota_snapshots                = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] quota_volumes                  = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] rate_limit_burst               = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] rate_limit_except_level        = CRITICAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] rate_limit_interval            = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] reinit_driver_count            = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] replication_device             = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] report_discard_supported       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] report_interval                = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] reservation_clean_interval     = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] reservation_expire             = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] reserved_image_namespaces      = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] reserved_percentage            = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] rpc_response_timeout           = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] run_external_periodic_tasks    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] scst_target_driver             = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] scst_target_iqn_name           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_down_time              = 720 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] shell_completion               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] snapshot_name_template         = snapshot-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] snapshot_same_host             = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] split_loggers                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] state_path                     = /opt/stack/data/cinder {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] storage_availability_zone      = nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] storage_protocol               = iSCSI {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] syslog_log_facility            = LOG_USER {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] target_helper                  = lioadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] target_ip_address              = 192.168.122.157 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] target_port                    = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] target_protocol                = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] target_secondary_ip_addresses  = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] trace_flags                    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] transport_url                  = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] until_refresh                  = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] use_chap_auth                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] use_default_quota_class        = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] use_journal                    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] use_json                       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] use_multipath_for_image_xfer   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] use_stderr                     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] use_syslog                     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] verify_glance_signatures       = enabled {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_api_class               = cinder.volume.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_backend_name            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_clear                   = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_clear_ionice            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_clear_size              = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_copy_bps_limit          = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_dd_blocksize            = 1M {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_name_template           = volume-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_service_inithost_offload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volume_usage_audit_period      = month {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] zoning_mode                    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_concurrency.disable_process_locking = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.admin_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.admin_token = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.admin_user  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack sudo[76003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 01 01:35:10 devstack cinder-volume[75998]: INFO cinder.volume.manager [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 01 01:35:10 devstack sudo[76003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_protocol = https {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_type   = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_uri    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.auth_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.cache       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.certfile    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.identity_uri = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.include_service_catalog = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.insecure    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.interface   = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.keyfile     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_password =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcache_username =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.region_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.service_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.backend                  = dogpile.cache.null {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.backend_argument         = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.backend_expiration_time  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.config_prefix            = cache.oslo {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.debug_cache_backend      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.enable_retry_client      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.enable_socket_keepalive  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.enabled                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.enforce_fips_mode        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.expiration_time          = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.hashclient_retry_attempts = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.memcache_dead_retry      = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.memcache_sasl_enabled    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.password                 = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.proxies                  = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.redis_db                 = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.redis_server             = localhost:6379 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.retry_attempts           = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.retry_delay              = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.socket_keepalive_count   = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.socket_keepalive_idle    = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.socket_keepalive_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.socket_timeout           = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.tls_allowed_ciphers      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.tls_cafile               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.tls_certfile             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.tls_enabled              = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.tls_keyfile              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cache.username                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.asyncio_connection    = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.asyncio_slave_connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.backend               = sqlalchemy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.connection            = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.connection_debug      = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.connection_parameters =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.connection_recycle_time = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.connection_trace      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.db_inc_retry_interval = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.db_max_retries        = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.db_max_retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.db_retry_interval     = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.max_overflow          = 50 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.max_pool_size         = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.max_retries           = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.mysql_wsrep_sync_wait = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.pool_timeout          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.retry_interval        = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.slave_connection      = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.sqlite_synchronous    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.synchronous_reader    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] database.use_db_reconnect      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.connection_string     = messaging:// {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.enabled               = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.es_doc_type           = notification {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.es_scroll_size        = 10000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.es_scroll_time        = 2m {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.filter_error_trace    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.hmac_keys             = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.sentinel_service_name = mymaster {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.socket_timeout        = 0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.trace_requests        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler.trace_sqlalchemy      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler_jaeger.process_tags   = {} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler_jaeger.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] profiler_otlp.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.enforce_new_defaults = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: WARNING oslo_config.cfg [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 01 01:35:10 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.enforce_scope      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.policy_default_rule = default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] coordination.backend_url       = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] privsep_osbrick.group          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] privsep_osbrick.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] privsep_osbrick.user           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_sys_admin.group         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_sys_admin.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] cinder_sys_admin.user          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.auth_section      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.auth_type         = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.cafile            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.certfile          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.collect_timing    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.insecure          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.keyfile           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.send_service_user_token = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.split_loggers     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] service_user.timeout           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.auth_section            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.auth_type               = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.certfile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.collect_timing          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.insecure                = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.keyfile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.region_name             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.split_loggers           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] glance.timeout                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.chap_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.chap_username =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.disk_geometry = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.driver_use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.extra_capabilities = {} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.filter_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.goodness_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.iscsi_target_flags =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.iscsi_write_cache = on {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.iser_port     = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:10 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.lvm_share_target = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.lvm_type      = auto {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.num_shell_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.report_discard_supported = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.reserved_percentage = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.target_helper = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.target_port   = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.target_protocol = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.trace_flags   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.unique_fqdn_network = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.use_chap_auth = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_backend_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_clear  = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_clear_size = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_reports.file_event_handler = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_reports.log_dir           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.backend_host       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.chap_password      = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.chap_username      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.disk_geometry      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.extra_capabilities = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.filter_function    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.goodness_function  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.iser_helper        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.iser_port          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.lvm_type           = auto {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.report_discard_supported = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.reserved_percentage = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.scst_target_driver = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.storage_protocol   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.target_ip_address  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.target_port        = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.trace_flags        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_clear       = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] lvmdriver-1.volumes_dir        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_notifications.driver = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_notifications.retry = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] key_manager.fixed_key          = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.barbican_api_version  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.barbican_endpoint     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.barbican_endpoint_type = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.barbican_region_name  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.cafile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.certfile              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.collect_timing        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.insecure              = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.keyfile               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.number_of_retries     = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.retry_delay           = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.send_service_user_token = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.split_loggers         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.timeout               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.verify_ssl            = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican.verify_ssl_path       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.auth_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.cafile   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.keyfile  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] barbican_service_user.timeout  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.approle_role_id          = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.approle_secret_id        = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.kv_mountpoint            = secret {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.kv_path                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.kv_version               = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.namespace                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.root_token_id            = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.ssl_ca_crt_file          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.timeout                  = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.use_ssl                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:35:11 devstack sudo[76003]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:11 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.872s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:11 devstack sudo[76240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:11 devstack sudo[76240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:11 devstack sudo[76240]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.632s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:35:11 devstack cinder-volume[75998]: INFO cinder.brick.local_dev.lvm [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:11 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:11 devstack sudo[76454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:35:11 devstack sudo[76454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:12 devstack sudo[76454]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:12 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:12 devstack cinder-volume[75998]: DEBUG cinder.brick.local_dev.lvm [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75998) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 01 01:35:12 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:12 devstack sudo[76571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:12 devstack sudo[76571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:13 devstack sudo[76571]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:13 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.992s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:13 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:13 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:13 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:13 devstack sudo[76770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:13 devstack sudo[76770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:14 devstack sudo[76770]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:14 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.813s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:14 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:14 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:14 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:14 devstack sudo[76774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 01 01:35:14 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:15 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:15 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.755s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:15 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:15 devstack sudo[76784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:35:15 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:15 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:15 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:15 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:15 devstack sudo[76789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:35:15 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:16 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:16 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:16 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:16 devstack sudo[76792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:35:16 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:17 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:17 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:17 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:17 devstack sudo[76797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:17 devstack sudo[76797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:17 devstack sudo[76797]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:17 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:17 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:17 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:17 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:17 devstack sudo[76804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:17 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:18 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:18 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:18 devstack cinder-volume[75998]: INFO cinder.volume.drivers.lvm [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 01 01:35:18 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:18 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:18 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:18 devstack sudo[76810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:18 devstack sudo[76810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:19 devstack sudo[76810]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:19 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.750s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:19 devstack cinder-volume[75998]: DEBUG cinder.volume.drivers.lvm [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Updating volume stats {{(pid=75998) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 01 01:35:19 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:19 devstack sudo[76926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:35:19 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:19 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:19 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:19 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:19 devstack sudo[76931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:35:19 devstack sudo[76931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:20 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:35:20 devstack sudo[76931]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:20 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:20 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:20 devstack sudo[77073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:20 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:20 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:21 devstack sudo[77079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:35:21 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:21 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:21 devstack cinder-volume[75998]: INFO cinder.volume.driver [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Driver hasn't implemented _init_vendor_properties()
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG cinder.volume.driver [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75998) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG oslo_db.sqlalchemy.engines [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75998) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG dbcounter [-] [75998] Writer thread running {{(pid=75998) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG cinder.db.sqlalchemy.api [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Building query based on filter {{(pid=75998) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}}
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG cinder.image.image_utils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75998) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 01 01:35:21 devstack cinder-volume[75998]: INFO cinder.keymgr.migration [None req-c4ea39e5-5f1d-4c42-8fd2-b20e916000dc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG cinder.volume.drivers.lvm [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Updating volume stats {{(pid=75998) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 01 01:35:21 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:21 devstack sudo[77083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:35:21 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:22 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:22 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:22 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:22 devstack sudo[77086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:35:22 devstack sudo[77086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:22 devstack sudo[77086]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:22 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:22 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:22 devstack sudo[77089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:22 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:23 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:23 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.608s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:23 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:23 devstack sudo[77093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:35:23 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:24 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG cinder.manager [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Notifying Schedulers of capabilities ... {{(pid=75998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:35:24 devstack cinder-volume[75998]: INFO cinder.volume.manager [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Driver initialization completed successfully.
Jun 01 01:35:24 devstack cinder-volume[75998]: INFO cinder.manager [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Initiating service 2 cleanup
Jun 01 01:35:24 devstack cinder-volume[75998]: INFO cinder.manager [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Service 2 cleanup completed.
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG cinder.service [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Creating RPC server for service cinder-volume {{(pid=75998) start /opt/stack/cinder/cinder/service.py:231}}
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG cinder.service [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75998) start /opt/stack/cinder/cinder/service.py:237}}
Jun 01 01:35:24 devstack cinder-volume[75998]: INFO cinder.volume.manager [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG cinder.volume.drivers.lvm [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Updating volume stats {{(pid=75998) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:24 devstack sudo[77100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:35:24 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:24 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:24 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:24 devstack sudo[77104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:35:24 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:25 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:25 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:25 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:25 devstack sudo[77107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:35:25 devstack sudo[77107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:26 devstack sudo[77107]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:26 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:26 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:35:26 devstack sudo[77164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:35:26 devstack sudo[77164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:35:26 devstack sudo[77164]: pam_unix(sudo:session): session closed for user root
Jun 01 01:35:26 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:35:26 devstack cinder-volume[75998]: INFO cinder.volume.manager [None req-add09ef4-2a4d-4297-a3f4-4aa362349b5a None None] Driver post RPC initialization completed successfully.
Jun 01 01:35:36 devstack cinder-volume[75998]: DEBUG dbcounter [-] [75998] Writing DB stats cinder:SELECT=3 {{(pid=75998) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:35:36 devstack cinder-volume[75998]: DEBUG dbcounter [-] [75998] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75998) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:35:46 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager._thread_info {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:35:46 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread count: 6 {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:35:46 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread info: [<_MainThread(MainThread, started 136119773225088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136119662490048)>, <Thread(Thread-3 (stat_writer), started daemon 136119666565056)>, <Thread(Rabbit-heartbeat, started daemon 136119661784960)>, <Thread(Thread-5 (_runner), started daemon 136119661901824)>, <Thread(Thread-7 (_runner), started daemon 136119661944704)>] {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:36:46 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:36:46 devstack cinder-volume[75998]: DEBUG cinder.volume.drivers.lvm [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Updating volume stats {{(pid=75998) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 01 01:36:46 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:36:46 devstack sudo[81855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:36:46 devstack sudo[81855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:36:47 devstack sudo[81855]: pam_unix(sudo:session): session closed for user root
Jun 01 01:36:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:36:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:36:47 devstack sudo[81858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:36:47 devstack sudo[81858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:36:47 devstack sudo[81858]: pam_unix(sudo:session): session closed for user root
Jun 01 01:36:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:36:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:36:47 devstack sudo[81877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:36:47 devstack sudo[81877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:36:48 devstack sudo[81877]: pam_unix(sudo:session): session closed for user root
Jun 01 01:36:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:36:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:36:48 devstack sudo[81880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:36:48 devstack sudo[81880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:36:49 devstack sudo[81880]: pam_unix(sudo:session): session closed for user root
Jun 01 01:36:49 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:36:49 devstack cinder-volume[75998]: DEBUG cinder.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Notifying Schedulers of capabilities ... {{(pid=75998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:36:49 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager._thread_info {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:36:49 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread count: 6 {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:36:49 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread info: [<_MainThread(MainThread, started 136119773225088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136119662490048)>, <Thread(Thread-3 (stat_writer), started daemon 136119666565056)>, <Thread(Rabbit-heartbeat, started daemon 136119661784960)>, <Thread(Thread-5 (_runner), started daemon 136119661901824)>, <Thread(Thread-7 (_runner), started daemon 136119661944704)>] {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:37:36 devstack cinder-volume[75998]: DEBUG dbcounter [-] [75998] Writing DB stats cinder:SELECT=1 {{(pid=75998) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:37:36 devstack cinder-volume[75998]: DEBUG dbcounter [-] [75998] Writing DB stats cinder:UPDATE=1 {{(pid=75998) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:37:46 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:37:46 devstack cinder-volume[75998]: DEBUG cinder.volume.drivers.lvm [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Updating volume stats {{(pid=75998) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 01 01:37:46 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:37:46 devstack sudo[82289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:37:46 devstack sudo[82289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:37:47 devstack sudo[82289]: pam_unix(sudo:session): session closed for user root
Jun 01 01:37:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:37:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:37:47 devstack sudo[82294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:37:47 devstack sudo[82294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:37:47 devstack sudo[82294]: pam_unix(sudo:session): session closed for user root
Jun 01 01:37:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:37:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:37:48 devstack sudo[82298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:37:48 devstack sudo[82298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:37:48 devstack sudo[82298]: pam_unix(sudo:session): session closed for user root
Jun 01 01:37:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:37:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:37:48 devstack sudo[82306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:37:48 devstack sudo[82306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:37:49 devstack sudo[82306]: pam_unix(sudo:session): session closed for user root
Jun 01 01:37:49 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:37:49 devstack cinder-volume[75998]: DEBUG cinder.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Notifying Schedulers of capabilities ... {{(pid=75998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:37:49 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager._thread_info {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:37:49 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread count: 6 {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:37:49 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread info: [<_MainThread(MainThread, started 136119773225088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136119662490048)>, <Thread(Thread-3 (stat_writer), started daemon 136119666565056)>, <Thread(Rabbit-heartbeat, started daemon 136119661784960)>, <Thread(Thread-5 (_runner), started daemon 136119661901824)>, <Thread(Thread-7 (_runner), started daemon 136119661944704)>] {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:38:46 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:38:46 devstack cinder-volume[75998]: DEBUG cinder.volume.drivers.lvm [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Updating volume stats {{(pid=75998) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 01 01:38:46 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:38:46 devstack sudo[84451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:38:46 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:38:47 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root
Jun 01 01:38:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:38:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:38:47 devstack sudo[84465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:38:47 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:38:48 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root
Jun 01 01:38:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:38:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:38:48 devstack sudo[84487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:38:48 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:38:48 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root
Jun 01 01:38:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:38:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:38:48 devstack sudo[84497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:38:48 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:38:49 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root
Jun 01 01:38:49 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:38:49 devstack cinder-volume[75998]: DEBUG cinder.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Notifying Schedulers of capabilities ... {{(pid=75998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:39:36 devstack cinder-volume[75998]: DEBUG dbcounter [-] [75998] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75998) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:39:46 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:39:46 devstack cinder-volume[75998]: DEBUG cinder.volume.drivers.lvm [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Updating volume stats {{(pid=75998) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 01 01:39:46 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:39:46 devstack sudo[85495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 01 01:39:46 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:39:47 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root
Jun 01 01:39:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:39:47 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:39:47 devstack sudo[85517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:39:47 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:39:48 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root
Jun 01 01:39:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:39:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:39:48 devstack sudo[85547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 01 01:39:48 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:39:48 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root
Jun 01 01:39:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:39:48 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:39:48 devstack sudo[85583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 01 01:39:48 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:39:49 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root
Jun 01 01:39:49 devstack cinder-volume[75998]: DEBUG oslo_concurrency.processutils [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=75998) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:39:49 devstack cinder-volume[75998]: DEBUG cinder.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Notifying Schedulers of capabilities ... {{(pid=75998) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:39:49 devstack cinder-volume[75998]: DEBUG oslo_service.periodic_task [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] Running periodic task VolumeManager._thread_info {{(pid=75998) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:39:49 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread count: 6 {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:39:49 devstack cinder-volume[75998]: DEBUG cinder.volume.manager [None req-ee054b0b-60c7-46ce-ac7b-28b7eedacb11 None None] thread info: [<_MainThread(MainThread, started 136119773225088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136119662490048)>, <Thread(Thread-3 (stat_writer), started daemon 136119666565056)>, <Thread(Rabbit-heartbeat, started daemon 136119661784960)>, <Thread(Thread-5 (_runner), started daemon 136119661901824)>, <Thread(Thread-7 (_runner), started daemon 136119661944704)>] {{(pid=75998) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:39:50 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Caught SIGTERM, stopping children
Jun 01 01:39:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 01 01:39:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 01 01:39:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 01 01:39:50 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Stop services. {{(pid=75826) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 01 01:39:50 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Killing children. {{(pid=75826) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 01 01:39:50 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Waiting on 1 children to exit
Jun 01 01:39:55 devstack cinder-volume[75998]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 01 01:39:57 devstack cinder-volume[85708]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 01 01:39:57 devstack cinder-volume[85708]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 01 01:39:57 devstack cinder-volume[85708]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 01 01:39:58 devstack cinder-volume[85708]: INFO dbcounter [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Registered counter for database cinder
Jun 01 01:39:58 devstack cinder-volume[85708]: DEBUG oslo_db.sqlalchemy.engines [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:39:58 devstack cinder-volume[85708]: DEBUG dbcounter [-] [85708] Writer thread running {{(pid=85708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 01 01:39:58 devstack cinder-volume[85708]: INFO cinder.rpc [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 01 01:39:58 devstack cinder-volume[85708]: INFO cinder.rpc [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 01 01:39:58 devstack cinder-volume[85708]: DEBUG oslo_db.sqlalchemy.engines [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:39:58 devstack cinder-volume[85708]: INFO cinder.volume.manager [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Determined volume DB was empty at startup.
Jun 01 01:39:58 devstack cinder-volume[85708]: DEBUG cinder.volume.manager [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85708) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 01 01:39:58 devstack cinder-volume[85708]: INFO cinder.volume.manager [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 01 01:39:58 devstack cinder-volume[85708]: WARNING stevedore.named [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 01 01:39:58 devstack cinder-volume[85708]: WARNING castellan.key_manager [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 01 01:39:58 devstack cinder-volume[85708]: WARNING cinder.keymgr.conf_key_mgr [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 01 01:39:59 devstack cinder-volume[85708]: INFO cinder.volume.manager [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_db.sqlalchemy.engines [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:39:59 devstack cinder-volume[85708]: INFO oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Starting 1 workers
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Started child 85934 {{(pid=85708) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Full set of CONF: {{(pid=85708) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] ******************************************************************************** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Configuration options gathered from: {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] ================================================================================ {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] allow_availability_zone_fallback = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] allow_compression_on_image_upload = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] allowed_direct_url_schemes     = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] api_rate_limit                 = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] auth_strategy                  = keystone {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_availability_zone      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_host                   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_name                   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_stats_polling_interval = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backup_api_class               = cinder.backup.api.API {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backup_name_template           = backup-%s {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85934]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backup_use_same_host           = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backup_use_temp_snapshot       = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] chap_password                  = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] chap_username                  =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_internal_tenant_project_id = 2454f5f529d04f539c26db7f674ad9c1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_internal_tenant_user_id = 48f932cfe65c4d26b92e949bdfe60615 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cluster                        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] compression_format             = gzip {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] compute_api_class              = cinder.compute.nova.API {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] config_dir                     = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] config_source                  = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] control_exchange               = openstack {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] debug                          = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] default_availability_zone      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] default_group_type             = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] default_volume_type            = QuobyteHD {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] disk_geometry                  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] driver_client_cert             = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] driver_client_cert_key         = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] driver_data_namespace          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] driver_ssl_cert_path           = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] driver_ssl_cert_verify         = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] driver_use_ssl                 = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] enable_new_services            = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] enable_unsupported_driver      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] enabled_backends               = ['QuobyteHD'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] enforce_multipath_for_image_xfer = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] filter_function                = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_api_insecure            = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_api_servers             = ['http://192.168.122.157/image'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_api_ssl_compression     = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_ca_certificates_file    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_catalog_info            = image:glance:publicURL {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_certfile                = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_keyfile                 = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_num_retries             = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance_request_timeout         = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] goodness_function              = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] graceful_shutdown_timeout      = 5 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] group_api_class                = cinder.group.api.API {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] host                           = devstack {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_compress_on_upload       = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_conversion_address_space_limit = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_conversion_cpu_limit     = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_conversion_disable       = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_upload_use_cinder_backend = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_upload_use_internal_tenant = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_volume_cache_enabled     = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_volume_cache_max_count   = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] image_volume_cache_max_size_gb = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] init_host_max_objects_retrieval = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] instance_format                = [instance: %(uuid)s]  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] iscsi_target_flags             =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] iscsi_write_cache              = on {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] iser_helper                    = tgtadm {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] iser_ip_address                = 192.168.122.157 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] iser_port                      = 3260 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_color                      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_config_append              = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_dir                        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_file                       = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_options                    = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_rotate_interval            = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_rotate_interval_type       = days {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] log_rotation_type              = none {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] max_age                        = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] max_logfile_count              = 30 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] max_logfile_size_mb            = 200 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] max_over_subscription_ratio    = 20.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] message_reap_interval          = 86400 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] message_ttl                    = 2592000 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] migration_create_volume_timeout_secs = 300 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] monkey_patch                   = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] monkey_patch_modules           = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] my_ip                          = 192.168.122.157 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] no_snapshot_gb_quota           = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] num_iser_scan_tries            = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] num_shell_tries                = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] num_volume_device_scan_tries   = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] nvmeof_conn_info_version       = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] nvmet_ns_id                    = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] nvmet_port_id                  = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] osapi_max_limit                = 1000 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] osapi_volume_ext_list          = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] osapi_volume_listen_port       = 8776 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] osapi_volume_use_ssl           = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] osapi_volume_workers           = 2 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] per_volume_size_limit          = -1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] periodic_fuzzy_delay           = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] periodic_interval              = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] public_endpoint                = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85934]: INFO cinder.volume.manager [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.remotefs [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85934) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] publish_errors                 = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] quota_backup_gigabytes         = 1000 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] quota_backups                  = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] quota_gigabytes                = 1000 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] quota_groups                   = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] quota_snapshots                = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] quota_volumes                  = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] rate_limit_burst               = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] rate_limit_except_level        = CRITICAL {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] rate_limit_interval            = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] reinit_driver_count            = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] replication_device             = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] report_discard_supported       = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] report_interval                = 120 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] reservation_clean_interval     = 86400 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] reservation_expire             = 86400 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] reserved_image_namespaces      = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] reserved_percentage            = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] rpc_response_timeout           = 120 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] run_external_periodic_tasks    = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] scst_target_driver             = iscsi {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] scst_target_iqn_name           = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_down_time              = 720 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] shell_completion               = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] snapshot_name_template         = snapshot-%s {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] split_loggers                  = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] state_path                     = /opt/stack/data/cinder {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] storage_availability_zone      = nova {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] storage_protocol               = iSCSI {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] syslog_log_facility            = LOG_USER {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] target_helper                  = lioadm {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] target_ip_address              = 192.168.122.157 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] target_port                    = 3260 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] target_protocol                = iscsi {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] target_secondary_ip_addresses  = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] trace_flags                    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] transport_url                  = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] until_refresh                  = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] use_chap_auth                  = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] use_default_quota_class        = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] use_journal                    = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] use_json                       = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] use_multipath_for_image_xfer   = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] use_stderr                     = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] use_syslog                     = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] verify_glance_signatures       = enabled {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_api_class               = cinder.volume.api.API {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_backend_name            = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_clear                   = zero {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_clear_ionice            = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_clear_size              = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_copy_bps_limit          = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_dd_blocksize            = 1M {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_name_template           = volume-%s {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_service_inithost_offload = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volume_usage_audit_period      = month {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] zoning_mode                    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_concurrency.disable_process_locking = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.admin_password = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.admin_token = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.admin_user  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_admin_prefix =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_port   = 35357 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_protocol = https {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_section = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_type   = password {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_uri    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.auth_version = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.cache       = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.certfile    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.delay_auth_decision = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.http_connect_timeout = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.identity_uri = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.include_service_catalog = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.insecure    = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.interface   = public {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.keyfile     = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_password =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcache_username =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.region_name = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.service_token_roles_required = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.service_type = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.token_cache_time = 300 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.backend                  = dogpile.cache.null {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.backend_argument         = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.backend_expiration_time  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.config_prefix            = cache.oslo {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.debug_cache_backend      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.enable_retry_client      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.enable_socket_keepalive  = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.enabled                  = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.enforce_fips_mode        = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.expiration_time          = 600 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.hashclient_retry_attempts = 2 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.memcache_dead_retry      = 300 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.memcache_pool_maxsize    = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[75998]: DEBUG oslo_concurrency.lockutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Acquiring lock "singleton_lock" {{(pid=75998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 01 01:39:59 devstack cinder-volume[75998]: DEBUG oslo_concurrency.lockutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Acquired lock "singleton_lock" {{(pid=75998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 01 01:39:59 devstack cinder-volume[75998]: DEBUG oslo_concurrency.lockutils [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Releasing lock "singleton_lock" {{(pid=75998) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.memcache_sasl_enabled    = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.password                 = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.proxies                  = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.redis_db                 = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.redis_sentinel_service_name = mymaster {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.redis_server             = localhost:6379 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.retry_attempts           = 2 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.retry_delay              = 0.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.socket_keepalive_count   = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.socket_keepalive_idle    = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.socket_keepalive_interval = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.socket_timeout           = 1.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.tls_allowed_ciphers      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.tls_cafile               = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.tls_certfile             = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.tls_enabled              = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.tls_keyfile              = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cache.username                 = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.asyncio_connection    = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.asyncio_slave_connection = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.backend               = sqlalchemy {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.connection            = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.connection_debug      = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.connection_parameters =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.connection_recycle_time = 3600 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.connection_trace      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.db_inc_retry_interval = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.db_max_retries        = 20 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.db_max_retry_interval = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.db_retry_interval     = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.max_overflow          = 50 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85934) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 01 01:39:59 devstack cinder-volume[75998]: WARNING amqp [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.max_pool_size         = 5 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.max_retries           = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.mysql_wsrep_sync_wait = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.pool_timeout          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.retry_interval        = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.slave_connection      = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.sqlite_synchronous    = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85934]: WARNING cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 01 01:39:59 devstack cinder-volume[85934]: WARNING cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.synchronous_reader    = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] database.use_db_reconnect      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Running cmd (subprocess): mount.quobyte {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.connection_string     = messaging:// {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.enabled               = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.es_doc_type           = notification {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.es_scroll_size        = 10000 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.es_scroll_time        = 2m {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.filter_error_trace    = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.hmac_keys             = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.sentinel_service_name = mymaster {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.socket_timeout        = 0.1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.trace_requests        = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler.trace_sqlalchemy      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler_jaeger.process_tags   = {} {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler_jaeger.service_name_prefix = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] profiler_otlp.service_name_prefix = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.enforce_new_defaults = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: WARNING oslo_config.cfg [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.enforce_scope      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.policy_default_rule = default {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.policy_file        = policy.yaml {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] coordination.backend_url       = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[75998]: WARNING amqp [None req-b6456d7c-a3d7-4f07-b8f3-bef2eecc2d46 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] privsep_osbrick.group          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] privsep_osbrick.helper_command = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] privsep_osbrick.user           = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_sys_admin.group         = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_sys_admin.helper_command = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] cinder_sys_admin.user          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.auth_section      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.auth_type         = password {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.cafile            = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.certfile          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.collect_timing    = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.insecure          = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.keyfile           = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.send_service_user_token = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.split_loggers     = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] service_user.timeout           = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.auth_section            = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.auth_type               = password {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.certfile                = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.collect_timing          = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.insecure                = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.keyfile                 = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.region_name             = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.split_loggers           = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] glance.timeout                 = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.backend_availability_zone = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.chap_password = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.chap_username =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.disk_geometry = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.driver_client_cert = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.driver_client_cert_key = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.driver_data_namespace = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.driver_use_ssl = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.enable_unsupported_driver = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.extra_capabilities = {} {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.filter_function = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.goodness_function = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.iscsi_target_flags =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.iscsi_write_cache = on {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.iser_helper   = tgtadm {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.iser_port     = 3260 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_host      =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_login     = admin {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_mount_options = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_password  = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_private_key =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_share_path =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.num_shell_tries = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.nvmet_port_id = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.quobyte_client_cfg = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.quobyte_volume_url = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.replication_device = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.report_discard_supported = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.reserved_percentage = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.scst_target_driver = iscsi {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.scst_target_iqn_name = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.storage_protocol = iSCSI {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.target_helper = tgtadm {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.target_port   = 3260 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.target_protocol = iscsi {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.trace_flags   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.unique_fqdn_network = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.use_chap_auth = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_backend_name = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_clear  = zero {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_clear_ionice = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_clear_size = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_reports.file_event_handler = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_reports.log_dir           = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.backend_availability_zone = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.backend_host         = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.chap_password        = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.chap_username        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.chiscsi_conf         = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.disk_geometry        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.driver_client_cert   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.driver_client_cert_key = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.driver_data_namespace = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.driver_use_ssl       = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.extra_capabilities   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.filter_function      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.goodness_function    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.iser_helper          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.iser_ip_address      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.iser_port            = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.iser_target_prefix   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_host             = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_login            = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_mount_options    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_password         = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_private_key      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_share_path       = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_ssh_port         = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.num_shell_tries      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.nvmet_port_id        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.replication_device   = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.report_discard_supported = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.reserved_percentage  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.scst_target_driver   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.storage_protocol     = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.target_helper        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.target_ip_address    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.target_port          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.target_prefix        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.target_protocol      = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.trace_flags          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.use_chap_auth        = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_clear         = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_clear_size    = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] QuobyteHD.volumes_dir          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.ssl      = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_notifications.driver = [] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_notifications.retry = -1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] oslo_messaging_notifications.transport_url = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] key_manager.fixed_key          = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.barbican_api_version  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.barbican_endpoint     = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.barbican_endpoint_type = public {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.barbican_region_name  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.cafile                = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.certfile              = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.collect_timing        = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.insecure              = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.keyfile               = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.number_of_retries     = 60 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.retry_delay           = 1 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.send_service_user_token = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.split_loggers         = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.timeout               = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.verify_ssl            = True {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican.verify_ssl_path       = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.auth_section = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.auth_type = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.cafile   = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.certfile = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.collect_timing = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.insecure = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.keyfile  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.split_loggers = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] barbican_service_user.timeout  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.approle_role_id          = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.approle_secret_id        = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.kv_mountpoint            = secret {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.kv_path                  = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.kv_version               = 2 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.namespace                = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.root_token_id            = **** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.ssl_ca_crt_file          = None {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.timeout                  = 60.0 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.use_ssl                  = False {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:39:59 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] ******************************************************************************** {{(pid=85708) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 01 01:39:59 devstack quobyte-client[85935]: Reading configuration file: /etc/quobyte/client.cfg
Jun 01 01:39:59 devstack quobyte-client[85935]: Invalid parameters found, error: missing mount point.
Jun 01 01:39:59 devstack quobyte-client[85935]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 01 01:39:59 devstack quobyte-client[85935]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] CMD "mount.quobyte" returned: 1 in 0.247s {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=85934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:39:59 devstack cinder-volume[85934]: INFO cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 ...
Jun 01 01:39:59 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 -c /etc/quobyte/client-cinder.cfg {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:39:59 devstack sudo[85947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 -c /etc/quobyte/client-cinder.cfg
Jun 01 01:39:59 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:00 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:00 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.815s {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:00 devstack cinder-volume[85934]: INFO cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 succeeded
Jun 01 01:40:00 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=85934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:40:00 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.826s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:40:00 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:00 devstack sudo[86028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:40:00 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:00 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:00 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.618s {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:00 devstack cinder-volume[85934]: INFO cinder.volume.driver [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Driver hasn't implemented _init_vendor_properties()
Jun 01 01:40:00 devstack cinder-volume[85934]: DEBUG cinder.volume.driver [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85934) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_db.sqlalchemy.engines [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG dbcounter [-] [85934] Writer thread running {{(pid=85934) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.db.sqlalchemy.api [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Building query based on filter {{(pid=85934) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.image.image_utils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85934) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 01 01:40:01 devstack cinder-volume[85934]: INFO cinder.keymgr.migration [None req-cea46a71-95cd-4fbe-9d97-d437b528df35 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=85934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=85934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:01 devstack sudo[86047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:40:01 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:01 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.625s {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.manager [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Notifying Schedulers of capabilities ... {{(pid=85934) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:40:01 devstack cinder-volume[85934]: INFO cinder.volume.manager [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Driver initialization completed successfully.
Jun 01 01:40:01 devstack cinder-volume[85934]: INFO cinder.manager [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Initiating service 3 cleanup
Jun 01 01:40:01 devstack cinder-volume[85934]: INFO cinder.manager [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Service 3 cleanup completed.
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.service [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Creating RPC server for service cinder-volume {{(pid=85934) start /opt/stack/cinder/cinder/service.py:231}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.service [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85934) start /opt/stack/cinder/cinder/service.py:237}}
Jun 01 01:40:01 devstack cinder-volume[85934]: INFO cinder.volume.manager [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=85934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=85934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:40:01 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:01 devstack sudo[86062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:40:01 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:02 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:02 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.806s {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:02 devstack cinder-volume[85934]: INFO cinder.volume.manager [None req-ea089b19-3cf4-4bbc-bf69-972998aa6806 None None] Driver post RPC initialization completed successfully.
Jun 01 01:40:06 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:40:06 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:40:06 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=85934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:40:06 devstack cinder-volume[85934]: DEBUG cinder.volume.drivers.quobyte [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=85934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:40:06 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:40:06 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:06 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:40:06 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:07 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:07 devstack cinder-volume[85934]: DEBUG oslo_concurrency.processutils [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.557s {{(pid=85934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:07 devstack cinder-volume[85934]: DEBUG cinder.manager [None req-930d1b46-1788-4bdc-9ec7-8b462962cbdb None None] Notifying Schedulers of capabilities ... {{(pid=85934) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:40:09 devstack cinder-volume[85708]: DEBUG dbcounter [-] [85708] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:40:10 devstack cinder-volume[85708]: INFO oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Caught SIGTERM, stopping children
Jun 01 01:40:10 devstack cinder-volume[85708]: DEBUG oslo_concurrency.lockutils [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Acquiring lock "singleton_lock" {{(pid=85708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 01 01:40:10 devstack cinder-volume[85708]: DEBUG oslo_concurrency.lockutils [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Acquired lock "singleton_lock" {{(pid=85708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 01 01:40:10 devstack cinder-volume[85708]: DEBUG oslo_concurrency.lockutils [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Releasing lock "singleton_lock" {{(pid=85708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 01 01:40:10 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Stop services. {{(pid=85708) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 01 01:40:10 devstack cinder-volume[85708]: DEBUG oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Killing children. {{(pid=85708) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 01 01:40:10 devstack cinder-volume[85708]: INFO oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Waiting on 1 children to exit
Jun 01 01:40:12 devstack cinder-volume[85934]: DEBUG dbcounter [-] [85934] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85934) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:40:12 devstack cinder-volume[85934]: DEBUG dbcounter [-] [85934] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=85934) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:40:15 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Acquiring lock "singleton_lock" {{(pid=85934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 01 01:40:15 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Acquired lock "singleton_lock" {{(pid=85934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 01 01:40:15 devstack cinder-volume[85934]: DEBUG oslo_concurrency.lockutils [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Releasing lock "singleton_lock" {{(pid=85934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 01 01:40:15 devstack cinder-volume[85934]: WARNING amqp [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 01 01:40:15 devstack cinder-volume[85934]: WARNING amqp [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 01 01:40:15 devstack cinder-volume[85708]: INFO oslo_service.backend._eventlet.service [None req-cc33eaab-bcc6-47ae-a8cf-bf765b5ff5bc None None] Child 85934 exited with status 0
Jun 01 01:40:18 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 01 01:40:18 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 01 01:40:18 devstack cinder-volume[86433]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86433) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 01 01:40:18 devstack cinder-volume[86433]: INFO dbcounter [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Registered counter for database cinder
Jun 01 01:40:18 devstack cinder-volume[86433]: DEBUG oslo_db.sqlalchemy.engines [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:40:18 devstack cinder-volume[86433]: DEBUG dbcounter [-] [86433] Writer thread running {{(pid=86433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 01 01:40:18 devstack cinder-volume[86433]: INFO cinder.rpc [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 01 01:40:18 devstack cinder-volume[86433]: INFO cinder.rpc [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 01 01:40:18 devstack cinder-volume[86433]: DEBUG oslo_db.sqlalchemy.engines [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:40:19 devstack cinder-volume[86433]: INFO cinder.volume.manager [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Determined volume DB was empty at startup.
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG cinder.volume.manager [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86433) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 01 01:40:19 devstack cinder-volume[86433]: WARNING stevedore.named [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 01 01:40:19 devstack cinder-volume[86433]: WARNING castellan.key_manager [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 01 01:40:19 devstack cinder-volume[86433]: WARNING cinder.keymgr.conf_key_mgr [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 01 01:40:19 devstack cinder-volume[86433]: INFO cinder.volume.manager [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_db.sqlalchemy.engines [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:40:19 devstack cinder-volume[86433]: INFO oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Starting 1 workers
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Started child 86676 {{(pid=86433) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Full set of CONF: {{(pid=86433) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] ******************************************************************************** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Configuration options gathered from: {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] ================================================================================ {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] allow_availability_zone_fallback = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] allow_compression_on_image_upload = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] allowed_direct_url_schemes     = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] api_rate_limit                 = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] auth_strategy                  = keystone {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_availability_zone      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_host                   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_name                   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_stats_polling_interval = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backup_api_class               = cinder.backup.api.API {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backup_name_template           = backup-%s {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backup_use_same_host           = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backup_use_temp_snapshot       = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] chap_password                  = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86676]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] chap_username                  =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_internal_tenant_project_id = 2454f5f529d04f539c26db7f674ad9c1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_internal_tenant_user_id = 48f932cfe65c4d26b92e949bdfe60615 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cluster                        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] compression_format             = gzip {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] config_dir                     = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] config_source                  = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] control_exchange               = openstack {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] debug                          = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] default_availability_zone      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] default_group_type             = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] default_volume_type            = QuobyteHD {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] disk_geometry                  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] driver_client_cert             = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] driver_client_cert_key         = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] driver_data_namespace          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] driver_ssl_cert_path           = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] driver_ssl_cert_verify         = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] driver_use_ssl                 = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] enable_new_services            = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] enable_unsupported_driver      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] enforce_multipath_for_image_xfer = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] filter_function                = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_api_insecure            = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_api_servers             = ['http://192.168.122.157/image'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_api_ssl_compression     = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_ca_certificates_file    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_certfile                = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_keyfile                 = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_num_retries             = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance_request_timeout         = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] goodness_function              = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] graceful_shutdown_timeout      = 5 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] group_api_class                = cinder.group.api.API {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] host                           = devstack {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_compress_on_upload       = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_conversion_address_space_limit = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_conversion_cpu_limit     = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_conversion_disable       = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_upload_use_cinder_backend = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_upload_use_internal_tenant = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_volume_cache_enabled     = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_volume_cache_max_count   = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] image_volume_cache_max_size_gb = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] init_host_max_objects_retrieval = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] iscsi_target_flags             =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] iscsi_write_cache              = on {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] iser_helper                    = tgtadm {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] iser_ip_address                = 192.168.122.157 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] iser_port                      = 3260 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_color                      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_config_append              = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_dir                        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_file                       = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_options                    = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_rotate_interval            = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_rotate_interval_type       = days {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] log_rotation_type              = none {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] max_age                        = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] max_logfile_count              = 30 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] max_logfile_size_mb            = 200 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] max_over_subscription_ratio    = 20.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] message_reap_interval          = 86400 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] message_ttl                    = 2592000 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] migration_create_volume_timeout_secs = 300 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] monkey_patch                   = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] monkey_patch_modules           = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] my_ip                          = 192.168.122.157 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] no_snapshot_gb_quota           = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] num_iser_scan_tries            = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] num_shell_tries                = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] num_volume_device_scan_tries   = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] nvmeof_conn_info_version       = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] nvmet_ns_id                    = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] nvmet_port_id                  = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] osapi_max_limit                = 1000 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] osapi_volume_ext_list          = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] osapi_volume_listen_port       = 8776 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] osapi_volume_use_ssl           = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] osapi_volume_workers           = 2 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] per_volume_size_limit          = -1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] periodic_fuzzy_delay           = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] periodic_interval              = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] public_endpoint                = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] publish_errors                 = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] quota_backup_gigabytes         = 1000 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] quota_backups                  = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] quota_gigabytes                = 1000 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] quota_groups                   = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] quota_snapshots                = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] quota_volumes                  = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] rate_limit_burst               = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] rate_limit_except_level        = CRITICAL {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] rate_limit_interval            = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] reinit_driver_count            = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] replication_device             = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] report_discard_supported       = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] report_interval                = 120 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] reservation_clean_interval     = 86400 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] reservation_expire             = 86400 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] reserved_image_namespaces      = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] reserved_percentage            = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] rpc_response_timeout           = 120 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86676) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] run_external_periodic_tasks    = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] scst_target_driver             = iscsi {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] scst_target_iqn_name           = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_down_time              = 720 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] shell_completion               = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] snapshot_name_template         = snapshot-%s {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] split_loggers                  = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] state_path                     = /opt/stack/data/cinder {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] storage_availability_zone      = nova {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] storage_protocol               = iSCSI {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] syslog_log_facility            = LOG_USER {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] target_helper                  = lioadm {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] target_ip_address              = 192.168.122.157 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] target_port                    = 3260 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] target_protocol                = iscsi {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] target_secondary_ip_addresses  = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] trace_flags                    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] transport_url                  = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] until_refresh                  = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] use_chap_auth                  = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] use_default_quota_class        = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] use_journal                    = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] use_json                       = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] use_multipath_for_image_xfer   = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] use_stderr                     = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] use_syslog                     = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] verify_glance_signatures       = enabled {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_api_class               = cinder.volume.api.API {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_backend_name            = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_clear                   = zero {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_clear_ionice            = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_clear_size              = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_copy_bps_limit          = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_dd_blocksize            = 1M {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_name_template           = volume-%s {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_service_inithost_offload = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volume_usage_audit_period      = month {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] zoning_mode                    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_concurrency.disable_process_locking = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.admin_password = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.admin_token = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.admin_user  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_port   = 35357 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_protocol = https {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_section = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_type   = password {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_uri    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.auth_version = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.cache       = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.certfile    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.identity_uri = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.include_service_catalog = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.insecure    = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.interface   = public {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.keyfile     = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_password =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcache_username =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.region_name = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.service_token_roles_required = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.service_type = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.backend                  = dogpile.cache.null {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.backend_argument         = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.backend_expiration_time  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.config_prefix            = cache.oslo {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.debug_cache_backend      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.enable_retry_client      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.enable_socket_keepalive  = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.enabled                  = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.enforce_fips_mode        = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.expiration_time          = 600 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.hashclient_retry_attempts = 2 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.memcache_dead_retry      = 300 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.memcache_sasl_enabled    = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.password                 = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.proxies                  = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.redis_db                 = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.redis_server             = localhost:6379 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.retry_attempts           = 2 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.retry_delay              = 0.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.socket_keepalive_count   = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.socket_keepalive_idle    = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.socket_keepalive_interval = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.socket_timeout           = 1.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.tls_allowed_ciphers      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.tls_cafile               = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.tls_certfile             = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.tls_enabled              = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.tls_keyfile              = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cache.username                 = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.asyncio_connection    = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.asyncio_slave_connection = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.backend               = sqlalchemy {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.connection            = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.connection_debug      = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.connection_parameters =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.connection_recycle_time = 3600 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.connection_trace      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.db_inc_retry_interval = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.db_max_retries        = 20 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.db_max_retry_interval = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.db_retry_interval     = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.max_overflow          = 50 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.max_pool_size         = 5 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.max_retries           = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.mysql_wsrep_sync_wait = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.pool_timeout          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.retry_interval        = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.slave_connection      = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.sqlite_synchronous    = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.synchronous_reader    = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] database.use_db_reconnect      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.connection_string     = messaging:// {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.enabled               = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.es_doc_type           = notification {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.es_scroll_size        = 10000 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.es_scroll_time        = 2m {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.filter_error_trace    = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.hmac_keys             = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.sentinel_service_name = mymaster {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.socket_timeout        = 0.1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.trace_requests        = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler.trace_sqlalchemy      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler_jaeger.process_tags   = {} {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler_jaeger.service_name_prefix = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] profiler_otlp.service_name_prefix = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.enforce_new_defaults = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: WARNING oslo_config.cfg [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.enforce_scope      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.policy_default_rule = default {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] coordination.backend_url       = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] privsep_osbrick.group          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] privsep_osbrick.helper_command = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] privsep_osbrick.user           = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_sys_admin.group         = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_sys_admin.helper_command = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] cinder_sys_admin.user          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.auth_section      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.auth_type         = password {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.cafile            = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.certfile          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.collect_timing    = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.insecure          = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.keyfile           = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.send_service_user_token = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.split_loggers     = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86676) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 01 01:40:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 01 01:40:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] service_user.timeout           = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.auth_section            = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.auth_type               = password {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.certfile                = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.collect_timing          = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.insecure                = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.keyfile                 = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.region_name             = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Running cmd (subprocess): mount.quobyte {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.split_loggers           = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] glance.timeout                 = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.backend_availability_zone = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.chap_password = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.chap_username =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.disk_geometry = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.driver_client_cert = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.driver_client_cert_key = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.driver_data_namespace = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.driver_use_ssl = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.extra_capabilities = {} {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.filter_function = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.goodness_function = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.iscsi_target_flags =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.iscsi_write_cache = on {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.iser_port     = 3260 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_host      =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_login     = admin {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_mount_options = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_password  = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_private_key =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_share_path =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.num_shell_tries = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.quobyte_volume_url = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.replication_device = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.report_discard_supported = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.reserved_percentage = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.target_helper = tgtadm {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.target_port   = 3260 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.target_protocol = iscsi {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.trace_flags   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.unique_fqdn_network = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.use_chap_auth = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_backend_name = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_clear  = zero {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_clear_ionice = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_clear_size = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_reports.file_event_handler = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_reports.log_dir           = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.backend_availability_zone = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.backend_host         = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.chap_password        = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.chap_username        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.disk_geometry        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.driver_client_cert   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.driver_data_namespace = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.extra_capabilities   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.filter_function      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.goodness_function    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.iser_helper          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.iser_ip_address      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.iser_port            = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack quobyte-client[86683]: Reading configuration file: /etc/quobyte/client.cfg
Jun 01 01:40:19 devstack quobyte-client[86683]: Invalid parameters found, error: missing mount point.
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_host             = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_login            = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack quobyte-client[86683]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_mount_options    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_password         = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_private_key      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack quobyte-client[86683]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_share_path       = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.num_shell_tries      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.replication_device   = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.report_discard_supported = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.reserved_percentage  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.scst_target_driver   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.storage_protocol     = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.target_helper        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.target_ip_address    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.target_port          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.target_prefix        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.target_protocol      = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.trace_flags          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.use_chap_auth        = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_clear         = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_clear_size    = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] QuobyteHD.volumes_dir          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_notifications.driver = [] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_notifications.retry = -1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] key_manager.fixed_key          = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.barbican_api_version  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.barbican_endpoint     = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.barbican_endpoint_type = public {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.barbican_region_name  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.cafile                = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.certfile              = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.collect_timing        = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.insecure              = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.keyfile               = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.number_of_retries     = 60 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.retry_delay           = 1 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.send_service_user_token = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.split_loggers         = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.timeout               = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.verify_ssl            = True {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican.verify_ssl_path       = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.auth_section = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.auth_type = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.cafile   = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.certfile = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.collect_timing = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.insecure = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.keyfile  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.split_loggers = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] barbican_service_user.timeout  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.approle_role_id          = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.approle_secret_id        = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.kv_mountpoint            = secret {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.kv_path                  = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.kv_version               = 2 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.namespace                = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.root_token_id            = **** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.ssl_ca_crt_file          = None {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.timeout                  = 60.0 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.use_ssl                  = False {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 01 01:40:19 devstack cinder-volume[86433]: DEBUG oslo_service.backend._eventlet.service [None req-306fb562-e26b-4e91-b374-24079b8b3407 None None] ******************************************************************************** {{(pid=86433) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 01 01:40:19 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:40:19 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:19 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.616s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:19 devstack cinder-volume[86676]: INFO cinder.volume.driver [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Driver hasn't implemented _init_vendor_properties()
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.volume.driver [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86676) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_db.sqlalchemy.engines [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writer thread running {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.db.sqlalchemy.api [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Building query based on filter {{(pid=86676) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86676) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:40:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:19 devstack cinder-volume[86676]: INFO cinder.keymgr.migration [None req-f0777cfe-cc6f-47d2-9124-d4cf96ade947 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 01 01:40:20 devstack sudo[86693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:40:20 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:20 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.584s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:40:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Driver initialization completed successfully.
Jun 01 01:40:20 devstack cinder-volume[86676]: INFO cinder.manager [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Initiating service 3 cleanup
Jun 01 01:40:20 devstack cinder-volume[86676]: INFO cinder.manager [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Service 3 cleanup completed.
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG cinder.service [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Creating RPC server for service cinder-volume {{(pid=86676) start /opt/stack/cinder/cinder/service.py:231}}
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG cinder.service [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86676) start /opt/stack/cinder/cinder/service.py:237}}
Jun 01 01:40:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:40:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:40:20 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:40:20 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:40:21 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Jun 01 01:40:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.597s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:40:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0e033ab7-1fed-4516-a607-962c2470c87f None None] Driver post RPC initialization completed successfully.
Jun 01 01:40:29 devstack cinder-volume[86433]: DEBUG dbcounter [-] [86433] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:40:30 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:40:31 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:40:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:40:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 6 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:40:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:41:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:41:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:41:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:41:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:41:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:41:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:41:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:41:52 devstack sudo[87384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:41:52 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:41:54 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root
Jun 01 01:41:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.861s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:41:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:41:54 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:41:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 6 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:41:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Flow 'volume_create_manager' (b58d8ec5-4a5e-4494-929e-1ffde28459ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70dcd8d-0a7c-4fd9-80c6-2a5e29ede437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70dcd8d-0a7c-4fd9-80c6-2a5e29ede437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-326543927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e958d8a-e9e4-46d3-a291-00a43d06dbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bf08c1b2634c20b4113d111e446258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:41:56Z,use_quota=True,user_id='82b27669a59f40ddb496e3d074525cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc44888-7a5c-4a5d-92bf-1357a88e521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc44888-7a5c-4a5d-92bf-1357a88e521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a0f39d-4452-4090-b166-39b9415e8b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a0f39d-4452-4090-b166-39b9415e8b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e958d8a-e9e4-46d3-a291-00a43d06dbe3', 'volume_name': 'volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9ad87f-ceda-4c43-bd37-c362d47b6102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9ad87f-ceda-4c43-bd37-c362d47b6102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f08857-174c-4cf0-acf1-14ea2c6c291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Volume 1e958d8a-e9e4-46d3-a291-00a43d06dbe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3', 'volume_size': 1}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-326543927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e958d8a-e9e4-46d3-a291-00a43d06dbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bf08c1b2634c20b4113d111e446258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:41:56Z,use_quota=True,user_id='82b27669a59f40ddb496e3d074525cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Creating volume 1e958d8a-e9e4-46d3-a291-00a43d06dbe3 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:41:55 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:41:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:41:55 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3 1073741824
Jun 01 01:41:55 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Flow 'volume_create_manager' (99267ba3-bc76-46c9-9f8b-a79647c7be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571fd209-4d08-4faa-b5f7-3820ae926400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571fd209-4d08-4faa-b5f7-3820ae926400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-425515322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9516a1-8957-46bc-a08d-0064ef0f4881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400aba1b446945f58cad627f19067504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:41:57Z,use_quota=True,user_id='219259fbfb96428387a6f13aa42433ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a95c74-93aa-4d69-9c67-db66c7c54ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a95c74-93aa-4d69-9c67-db66c7c54ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a8407b-29bc-4ccc-a8da-3297aba79dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a8407b-29bc-4ccc-a8da-3297aba79dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9516a1-8957-46bc-a08d-0064ef0f4881', 'volume_name': 'volume-dc9516a1-8957-46bc-a08d-0064ef0f4881', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c6a553-5494-4f4b-b7ef-f9533f47e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c6a553-5494-4f4b-b7ef-f9533f47e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f8e90-5e5f-4520-a57b-b16788839c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:56 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Volume dc9516a1-8957-46bc-a08d-0064ef0f4881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9516a1-8957-46bc-a08d-0064ef0f4881', 'volume_size': 1}
Jun 01 01:41:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:41:57 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Jun 01 01:41:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3 1073741824" returned: 0 in 2.014s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:41:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:41:58 devstack sudo[87793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3
Jun 01 01:41:58 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:41:58 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3" returned: 0 in 0.886s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] <== create_volume: return (2967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.974s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-425515322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9516a1-8957-46bc-a08d-0064ef0f4881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400aba1b446945f58cad627f19067504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:41:57Z,use_quota=True,user_id='219259fbfb96428387a6f13aa42433ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Creating volume dc9516a1-8957-46bc-a08d-0064ef0f4881 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:41:58 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:41:58 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881 1073741824
Jun 01 01:41:58 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f08857-174c-4cf0-acf1-14ea2c6c291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0561a0-6665-4777-916a-ef8dc25d5fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:41:58 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Volume volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3 (1e958d8a-e9e4-46d3-a291-00a43d06dbe3): created successfully
Jun 01 01:41:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0561a0-6665-4777-916a-ef8dc25d5fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:41:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Flow 'volume_create_manager' (b58d8ec5-4a5e-4494-929e-1ffde28459ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:41:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4a5f9f8c-46e7-414e-a25f-7ec95da452a6 tempest-VolumesAdminNegativeTest-779966118 None] Created volume successfully.
Jun 01 01:41:59 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Jun 01 01:41:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881 1073741824" returned: 0 in 1.026s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:41:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:00 devstack sudo[87804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881
Jun 01 01:42:00 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Acquiring lock "cinder-1e958d8a-e9e4-46d3-a291-00a43d06dbe3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Lock "cinder-1e958d8a-e9e4-46d3-a291-00a43d06dbe3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Acquiring lock "cinder-quobyte-1e958d8a-e9e4-46d3-a291-00a43d06dbe3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Lock "cinder-quobyte-1e958d8a-e9e4-46d3-a291-00a43d06dbe3" acquired by "delete_volume" :: waited 0.040s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:42:01 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyjpopgf1/privsep.sock']
Jun 01 01:42:01 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyjpopgf1/privsep.sock
Jun 01 01:42:01 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:01 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881" returned: 0 in 1.512s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] <== create_volume: return (2620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.626s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f8e90-5e5f-4520-a57b-b16788839c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9516a1-8957-46bc-a08d-0064ef0f4881', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1b0c11-dca2-41cc-80c1-17a339d8d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Volume volume-dc9516a1-8957-46bc-a08d-0064ef0f4881 (dc9516a1-8957-46bc-a08d-0064ef0f4881): created successfully
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1b0c11-dca2-41cc-80c1-17a339d8d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Flow 'volume_create_manager' (99267ba3-bc76-46c9-9f8b-a79647c7be71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:42:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-269845de-2003-41a1-8a22-bf788032d54d tempest-ServerRescueNegativeTestJSON-982323322 None] Created volume successfully.
Jun 01 01:42:03 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:03 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Spawned new privsep daemon via rootwrap
Jun 01 01:42:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Accepted privsep connection to /tmp/tmpyjpopgf1/privsep.sock {{(pid=86676) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Jun 01 01:42:03 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 01 01:42:03 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 01 01:42:03 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 01 01:42:03 devstack cinder-volume[86676]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87811
Jun 01 01:42:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[60feff6e-0017-4f6c-a95c-dce2248feef8]: (2,) {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:42:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdc663-db52-413f-a543-c1394e3aa689]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:42:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:04 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3
Jun 01 01:42:04 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:05 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3" returned: 0 in 1.668s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:05 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3
Jun 01 01:42:05 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:07 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1e958d8a-e9e4-46d3-a291-00a43d06dbe3" returned: 0 in 1.917s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Lock "cinder-quobyte-1e958d8a-e9e4-46d3-a291-00a43d06dbe3" released by "delete_volume" :: held 6.048s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:42:07 devstack cinder-volume[86676]: WARNING cinder.quota [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:42:07 devstack cinder-volume[86676]: WARNING cinder.quota [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Created reservations ['0a7fb3f0-50e4-4894-ab94-69c4fce68675', '2e1f566b-4bb1-4274-95d7-799ca02fefdd', '1e9b8c2d-6094-4825-9dec-2004c169188f', 'e25a2a94-ce19-4e51-a007-b720e29dd881'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:08 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:42:08 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:09 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.282s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:09 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:42:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Deleted volume successfully.
Jun 01 01:42:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-526c2f17-ec24-452c-bde4-1f519d79abe7 tempest-VolumesAdminNegativeTest-779966118 None] Lock "cinder-1e958d8a-e9e4-46d3-a291-00a43d06dbe3-delete_volume" released by "delete_volume" :: held 8.010s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:42:17 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:42:19 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Flow 'volume_create_manager' (b5f92ee3-986f-4030-92c5-e1ec46f8b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232c91f0-2279-4ff4-9304-a56b2311f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232c91f0-2279-4ff4-9304-a56b2311f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1464245574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d608e3-02cb-4af4-9e43-05c2c067a636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3570a3d5d5334374a408b61327fd626c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:42:22Z,use_quota=True,user_id='ee4ac90b5e014d8a88736443f0fccba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71f643e-8426-4394-801d-d6629c4a8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71f643e-8426-4394-801d-d6629c4a8237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33372c41-f1af-42ba-b26c-42a6fa9120a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33372c41-f1af-42ba-b26c-42a6fa9120a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d608e3-02cb-4af4-9e43-05c2c067a636', 'volume_name': 'volume-65d608e3-02cb-4af4-9e43-05c2c067a636', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a7ab29-f8d4-4516-a257-2517bfbf75bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a7ab29-f8d4-4516-a257-2517bfbf75bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732a7d65-6748-4750-a62d-768f5dd64f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Volume 65d608e3-02cb-4af4-9e43-05c2c067a636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d608e3-02cb-4af4-9e43-05c2c067a636', 'volume_size': 1}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1464245574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d608e3-02cb-4af4-9e43-05c2c067a636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3570a3d5d5334374a408b61327fd626c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:42:22Z,use_quota=True,user_id='ee4ac90b5e014d8a88736443f0fccba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Creating volume 65d608e3-02cb-4af4-9e43-05c2c067a636 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:42:22 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:42:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:22 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 1073741824
Jun 01 01:42:22 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:23 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 1073741824" returned: 0 in 1.412s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:24 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636
Jun 01 01:42:24 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Flow 'volume_create_manager' (08a64f84-fb97-485c-b6cc-d0a08203a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc4a87-df81-4584-ac77-ec1db18e954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc4a87-df81-4584-ac77-ec1db18e954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-616967726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719452cd-9275-4913-8766-58bdb349e570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c32dc99630d46b79a364b77ae50bc7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:42:24Z,use_quota=True,user_id='02d2f0b897714b6bac5813100ad7f6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f679b2-6d69-479b-99b3-7a069b8fa23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f679b2-6d69-479b-99b3-7a069b8fa23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2a161f-230a-47ba-a4da-672fa96cd122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2a161f-230a-47ba-a4da-672fa96cd122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719452cd-9275-4913-8766-58bdb349e570', 'volume_name': 'volume-719452cd-9275-4913-8766-58bdb349e570', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ceb0da-4922-4c63-aa20-06681f951f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ceb0da-4922-4c63-aa20-06681f951f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fcdcf2-7f61-476f-b938-69ed94bb928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Volume 719452cd-9275-4913-8766-58bdb349e570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719452cd-9275-4913-8766-58bdb349e570', 'volume_size': 1}
Jun 01 01:42:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:42:25 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636" returned: 0 in 1.449s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] <== create_volume: return (2969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.972s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-616967726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719452cd-9275-4913-8766-58bdb349e570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c32dc99630d46b79a364b77ae50bc7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:42:24Z,use_quota=True,user_id='02d2f0b897714b6bac5813100ad7f6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Creating volume 719452cd-9275-4913-8766-58bdb349e570 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:42:25 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732a7d65-6748-4750-a62d-768f5dd64f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d608e3-02cb-4af4-9e43-05c2c067a636', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a09b725-44b3-4acf-b5d5-b3fd773e1901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Volume volume-65d608e3-02cb-4af4-9e43-05c2c067a636 (65d608e3-02cb-4af4-9e43-05c2c067a636): created successfully
Jun 01 01:42:25 devstack sudo[88028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570 1073741824
Jun 01 01:42:25 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a09b725-44b3-4acf-b5d5-b3fd773e1901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Flow 'volume_create_manager' (b5f92ee3-986f-4030-92c5-e1ec46f8b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:42:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-46267f22-6aba-44ad-94f0-16af38850521 tempest-ServerActionsTestOtherA-1291260540 None] Created volume successfully.
Jun 01 01:42:26 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570 1073741824" returned: 0 in 1.355s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:26 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570
Jun 01 01:42:26 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:27 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570" returned: 0 in 0.773s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:42:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fcdcf2-7f61-476f-b938-69ed94bb928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719452cd-9275-4913-8766-58bdb349e570', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5801c7-5133-4594-bb9c-fe0596c94ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:42:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Volume volume-719452cd-9275-4913-8766-58bdb349e570 (719452cd-9275-4913-8766-58bdb349e570): created successfully
Jun 01 01:42:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5801c7-5133-4594-bb9c-fe0596c94ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:42:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Flow 'volume_create_manager' (08a64f84-fb97-485c-b6cc-d0a08203a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:42:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-72b4d424-ad0b-474f-bfe9-6af7a7286fba tempest-TaggedAttachmentsTest-2102536684 None] Created volume successfully.
Jun 01 01:42:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Acquiring lock "cinder-dc9516a1-8957-46bc-a08d-0064ef0f4881-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:42:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "cinder-dc9516a1-8957-46bc-a08d-0064ef0f4881-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:42:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Acquiring lock "cinder-quobyte-dc9516a1-8957-46bc-a08d-0064ef0f4881" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:42:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "cinder-quobyte-dc9516a1-8957-46bc-a08d-0064ef0f4881" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:42:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e65b9c-1630-4749-a537-7b95e37618db]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:42:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:33 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881
Jun 01 01:42:33 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:34 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881" returned: 0 in 1.154s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:34 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881
Jun 01 01:42:34 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:35 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9516a1-8957-46bc-a08d-0064ef0f4881" returned: 0 in 0.929s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "cinder-quobyte-dc9516a1-8957-46bc-a08d-0064ef0f4881" released by "delete_volume" :: held 2.147s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Created reservations ['593be57f-c55a-42dd-823e-e5952fd1e994', '500ced03-fd9f-4fd9-94c2-86b6f7b5c502', 'f6c240a9-2cef-47f9-99ac-18a725940225', '786b8a3f-7cb2-4d37-8d14-67b504c9ef52'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:35 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:42:35 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:36 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.426s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:42:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Deleted volume successfully.
Jun 01 01:42:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3f057e61-f901-4110-877d-8bbff9bdf81c tempest-ServerRescueNegativeTestJSON-982323322 None] Lock "cinder-dc9516a1-8957-46bc-a08d-0064ef0f4881-delete_volume" released by "delete_volume" :: held 4.091s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:42:45 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:42:46 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:42:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:42:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:42:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:42:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:42:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:42:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:42:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:42:52 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:42:52 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:42:53 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Jun 01 01:42:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.460s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:42:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:42:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:42:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:42:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:43:18 devstack cinder-volume[86676]: WARNING py.warnings [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jun 01 01:43:18 devstack cinder-volume[86676]:   .first()
Jun 01 01:43:18 devstack cinder-volume[86676]: 
Jun 01 01:43:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b6921-30cc-4023-8c42-afc4bed204ce]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:43:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:18 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636
Jun 01 01:43:18 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:19 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636" returned: 0 in 0.840s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-65d608e3-02cb-4af4-9e43-05c2c067a636', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b19b642b-5ba5-4e29-b36a-bb615070181b', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:43:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-eecf3600-353a-4db4-b342-b63770dafd7f req-16e83784-5077-4f1a-9a96-dc251d25b70d tempest-ServerActionsTestOtherA-1291260540 None] attachment_update completed successfully.
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Flow 'volume_create_manager' (33068f36-4069-4e0a-90db-5a2ce84f2d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332772d-3583-4dd0-8940-a9b2c1e57b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332772d-3583-4dd0-8940-a9b2c1e57b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1138638027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7349a7e1-d776-43a4-871b-bfcfbbf9f8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b739ea474044da9850e9c734cb26b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:43:23Z,use_quota=True,user_id='afa7ee1aaf964614bcd3204303922429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af54a7c-7f8b-43e6-bb30-d53639c467ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af54a7c-7f8b-43e6-bb30-d53639c467ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52e4377-d82c-4c29-9a61-4843848b27cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52e4377-d82c-4c29-9a61-4843848b27cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7349a7e1-d776-43a4-871b-bfcfbbf9f8ef', 'volume_name': 'volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74a8e67-93e4-4ecd-b7b0-af90223a3170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74a8e67-93e4-4ecd-b7b0-af90223a3170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46d888c-e5a5-4a4f-bb27-1752fd926c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:23 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Volume 7349a7e1-d776-43a4-871b-bfcfbbf9f8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef', 'volume_size': 1}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1138638027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7349a7e1-d776-43a4-871b-bfcfbbf9f8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b739ea474044da9850e9c734cb26b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:43:23Z,use_quota=True,user_id='afa7ee1aaf964614bcd3204303922429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Creating volume 7349a7e1-d776-43a4-871b-bfcfbbf9f8ef {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:43:23 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:43:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:23 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef 1073741824
Jun 01 01:43:23 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:24 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef 1073741824" returned: 0 in 1.244s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:24 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef
Jun 01 01:43:24 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:25 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef" returned: 0 in 0.860s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:43:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46d888c-e5a5-4a4f-bb27-1752fd926c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ca4b35-5fc1-48b8-a2d7-dbf4057d1c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Volume volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef (7349a7e1-d776-43a4-871b-bfcfbbf9f8ef): created successfully
Jun 01 01:43:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ca4b35-5fc1-48b8-a2d7-dbf4057d1c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Flow 'volume_create_manager' (33068f36-4069-4e0a-90db-5a2ce84f2d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:43:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-156fd8ca-b086-4195-9961-7a33aac22202 tempest-DeleteServersTestJSON-889024002 None] Created volume successfully.
Jun 01 01:43:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-2ca156f2-c217-4a12-92eb-deaaf3e87810 tempest-ServerActionsTestOtherA-1291260540 None] Terminate volume connection completed successfully.
Jun 01 01:43:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-2ca156f2-c217-4a12-92eb-deaaf3e87810 tempest-ServerActionsTestOtherA-1291260540 None] Deleting attachment b19b642b-5ba5-4e29-b36a-bb615070181b. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:43:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-6910dce7-fb52-444c-9f36-438729cc3772 req-d80668fa-bd56-4c25-bca9-2ab727aef94f tempest-DeleteServersTestJSON-889024002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-6910dce7-fb52-444c-9f36-438729cc3772 req-d80668fa-bd56-4c25-bca9-2ab727aef94f tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[304626ae-b436-4d1e-bd59-fced57af663e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:43:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-6910dce7-fb52-444c-9f36-438729cc3772 req-d80668fa-bd56-4c25-bca9-2ab727aef94f tempest-DeleteServersTestJSON-889024002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:32 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef
Jun 01 01:43:32 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-fda8e0cc-dd88-44d7-9d3f-690aacb7a004 tempest-ServerActionsTestOtherA-1291260540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:33 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-6910dce7-fb52-444c-9f36-438729cc3772 req-d80668fa-bd56-4c25-bca9-2ab727aef94f tempest-DeleteServersTestJSON-889024002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef" returned: 0 in 1.289s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-6910dce7-fb52-444c-9f36-438729cc3772 req-d80668fa-bd56-4c25-bca9-2ab727aef94f tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.352s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-fda8e0cc-dd88-44d7-9d3f-690aacb7a004 tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.630s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f10b940-c2f0-4a0c-8088-a802da6b4b25]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:43:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-fda8e0cc-dd88-44d7-9d3f-690aacb7a004 tempest-ServerActionsTestOtherA-1291260540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-6910dce7-fb52-444c-9f36-438729cc3772 req-d80668fa-bd56-4c25-bca9-2ab727aef94f tempest-DeleteServersTestJSON-889024002 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26ebfb1a-0a1f-4b45-abef-f7d43d2826dd', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:43:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-6910dce7-fb52-444c-9f36-438729cc3772 req-d80668fa-bd56-4c25-bca9-2ab727aef94f tempest-DeleteServersTestJSON-889024002 None] attachment_update completed successfully.
Jun 01 01:43:33 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636
Jun 01 01:43:33 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:34 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-fda8e0cc-dd88-44d7-9d3f-690aacb7a004 tempest-ServerActionsTestOtherA-1291260540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636" returned: 0 in 1.253s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-fda8e0cc-dd88-44d7-9d3f-690aacb7a004 tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.273s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-fda8e0cc-dd88-44d7-9d3f-690aacb7a004 tempest-ServerActionsTestOtherA-1291260540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-65d608e3-02cb-4af4-9e43-05c2c067a636', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6745703f-8107-46c0-b4e4-dd43abcb5bb1', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:43:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-e49a897a-c53d-42eb-84ee-9aa9120de1d9 req-fda8e0cc-dd88-44d7-9d3f-690aacb7a004 tempest-ServerActionsTestOtherA-1291260540 None] attachment_update completed successfully.
Jun 01 01:43:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b7f6896d-26fd-43ff-bd35-0d2694801e4a req-3ff95571-9865-4fcf-88f4-580a25d74875 tempest-TaggedAttachmentsTest-2102536684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b7f6896d-26fd-43ff-bd35-0d2694801e4a req-3ff95571-9865-4fcf-88f4-580a25d74875 tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7011d66d-0598-4ac7-bebd-e70af3dfa086]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:43:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b7f6896d-26fd-43ff-bd35-0d2694801e4a req-3ff95571-9865-4fcf-88f4-580a25d74875 tempest-TaggedAttachmentsTest-2102536684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:35 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570
Jun 01 01:43:35 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:37 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-b7f6896d-26fd-43ff-bd35-0d2694801e4a req-3ff95571-9865-4fcf-88f4-580a25d74875 tempest-TaggedAttachmentsTest-2102536684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570" returned: 0 in 1.265s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-b7f6896d-26fd-43ff-bd35-0d2694801e4a req-3ff95571-9865-4fcf-88f4-580a25d74875 tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.306s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-b7f6896d-26fd-43ff-bd35-0d2694801e4a req-3ff95571-9865-4fcf-88f4-580a25d74875 tempest-TaggedAttachmentsTest-2102536684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-719452cd-9275-4913-8766-58bdb349e570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d1e811a-9fdf-49b0-957f-9a619bfbb87c', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:43:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-b7f6896d-26fd-43ff-bd35-0d2694801e4a req-3ff95571-9865-4fcf-88f4-580a25d74875 tempest-TaggedAttachmentsTest-2102536684 None] attachment_update completed successfully.
Jun 01 01:43:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-bf4d1259-fe73-4086-a9fb-4d9a4cc4c606 req-38b2296b-2814-4dae-87a5-cb05c4a0704a tempest-DeleteServersTestJSON-889024002 None] Terminate volume connection completed successfully.
Jun 01 01:43:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-bf4d1259-fe73-4086-a9fb-4d9a4cc4c606 req-38b2296b-2814-4dae-87a5-cb05c4a0704a tempest-DeleteServersTestJSON-889024002 None] Deleting attachment 26ebfb1a-0a1f-4b45-abef-f7d43d2826dd. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:43:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-8e6c6fc6-eeb5-4742-865f-f777e31b9a76 req-bc1d4c2e-8942-42bd-a4f4-d71e8b514e91 tempest-TaggedAttachmentsTest-2102536684 None] Terminate volume connection completed successfully.
Jun 01 01:43:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-8e6c6fc6-eeb5-4742-865f-f777e31b9a76 req-bc1d4c2e-8942-42bd-a4f4-d71e8b514e91 tempest-TaggedAttachmentsTest-2102536684 None] Deleting attachment 2d1e811a-9fdf-49b0-957f-9a619bfbb87c. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:43:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Acquiring lock "cinder-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:43:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Lock "cinder-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:43:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Acquiring lock "cinder-quobyte-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:43:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Lock "cinder-quobyte-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:43:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d8b860-3884-479b-aed8-e01e530d8971]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:43:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:49 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef
Jun 01 01:43:49 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:50 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef" returned: 0 in 0.858s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:50 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef
Jun 01 01:43:50 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:50 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef" returned: 0 in 0.632s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Lock "cinder-quobyte-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef" released by "delete_volume" :: held 1.547s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Created reservations ['fde1c7bf-18cd-47ad-8e6e-0ec2a049bf4a', '087a91fe-6ab2-4c04-a17b-6c9543108e09', '794dd59d-3bd6-47fd-8e83-e132d4dd1f55', '1a290693-fc0e-4e64-aa1f-34f8800234ec'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:50 devstack sudo[89880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:43:50 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:51 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:51 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:43:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Deleted volume successfully.
Jun 01 01:43:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fedf7133-437f-4482-8f21-dd6e4da4b33d tempest-DeleteServersTestJSON-889024002 None] Lock "cinder-7349a7e1-d776-43a4-871b-bfcfbbf9f8ef-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:52 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:43:52 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:52 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.657s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:52 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:43:57 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:43:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Flow 'volume_create_manager' (e524b97c-5adc-46f8-bdbc-73ffe1f50767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:43:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cebfa1-0e1b-4ae3-96c4-ae1320dc95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cebfa1-0e1b-4ae3-96c4-ae1320dc95b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-471264026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efee4d77-0af5-422b-87bf-19830a3b85bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e8e8d75773462b9b90bb7deb9d3b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:43:58Z,use_quota=True,user_id='6756495a57bc4e22bc32db9f94da6715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ebf566-f71b-4790-b587-58e1d9ba6cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ebf566-f71b-4790-b587-58e1d9ba6cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdd92bb-c1f7-4727-85de-86072d269921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fdd92bb-c1f7-4727-85de-86072d269921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efee4d77-0af5-422b-87bf-19830a3b85bd', 'volume_name': 'volume-efee4d77-0af5-422b-87bf-19830a3b85bd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f52e5e-34a4-40d7-bf8b-11b2c3175ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f52e5e-34a4-40d7-bf8b-11b2c3175ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df71bc8b-0195-4435-8c2c-63ef7f297468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:58 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Volume efee4d77-0af5-422b-87bf-19830a3b85bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efee4d77-0af5-422b-87bf-19830a3b85bd', 'volume_size': 1}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-471264026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efee4d77-0af5-422b-87bf-19830a3b85bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e8e8d75773462b9b90bb7deb9d3b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:43:58Z,use_quota=True,user_id='6756495a57bc4e22bc32db9f94da6715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Creating volume efee4d77-0af5-422b-87bf-19830a3b85bd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:43:58 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:58 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd 1073741824
Jun 01 01:43:58 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:58 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd 1073741824" returned: 0 in 0.803s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:43:58 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd
Jun 01 01:43:58 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:43:59 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Jun 01 01:43:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:43:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:43:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:43:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df71bc8b-0195-4435-8c2c-63ef7f297468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efee4d77-0af5-422b-87bf-19830a3b85bd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c263ff-4516-45c2-87c3-c5069a2b0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:43:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Volume volume-efee4d77-0af5-422b-87bf-19830a3b85bd (efee4d77-0af5-422b-87bf-19830a3b85bd): created successfully
Jun 01 01:43:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c263ff-4516-45c2-87c3-c5069a2b0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:43:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Flow 'volume_create_manager' (e524b97c-5adc-46f8-bdbc-73ffe1f50767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:43:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d55c261f-5bc5-4d09-944c-6019d8226fda tempest-AttachVolumeNegativeTest-2081389715 None] Created volume successfully.
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-a33c8901-eb8f-4942-b134-3303249a7b81 req-8cb56f16-5856-43da-9caf-5bf482a33424 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-a33c8901-eb8f-4942-b134-3303249a7b81 req-8cb56f16-5856-43da-9caf-5bf482a33424 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[873f3d08-3b59-4615-8371-fb457a51781d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a33c8901-eb8f-4942-b134-3303249a7b81 req-8cb56f16-5856-43da-9caf-5bf482a33424 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:03 devstack sudo[90005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd
Jun 01 01:44:03 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Acquiring lock "cinder-719452cd-9275-4913-8766-58bdb349e570-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Lock "cinder-719452cd-9275-4913-8766-58bdb349e570-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Acquiring lock "cinder-quobyte-719452cd-9275-4913-8766-58bdb349e570" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:44:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Lock "cinder-quobyte-719452cd-9275-4913-8766-58bdb349e570" acquired by "delete_volume" :: waited 0.056s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:44:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa7d8e7-a421-4a04-95cc-69da7dd651a1]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:44:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:04 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570
Jun 01 01:44:04 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:04 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-a33c8901-eb8f-4942-b134-3303249a7b81 req-8cb56f16-5856-43da-9caf-5bf482a33424 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd" returned: 0 in 1.060s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-a33c8901-eb8f-4942-b134-3303249a7b81 req-8cb56f16-5856-43da-9caf-5bf482a33424 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.095s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:44:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-a33c8901-eb8f-4942-b134-3303249a7b81 req-8cb56f16-5856-43da-9caf-5bf482a33424 tempest-AttachVolumeNegativeTest-2081389715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-efee4d77-0af5-422b-87bf-19830a3b85bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51ef83c3-2fc0-49df-8c1d-76f79d1fafb3', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:44:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-a33c8901-eb8f-4942-b134-3303249a7b81 req-8cb56f16-5856-43da-9caf-5bf482a33424 tempest-AttachVolumeNegativeTest-2081389715 None] attachment_update completed successfully.
Jun 01 01:44:05 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570" returned: 0 in 1.125s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:05 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570
Jun 01 01:44:05 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:06 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-719452cd-9275-4913-8766-58bdb349e570" returned: 0 in 1.077s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Lock "cinder-quobyte-719452cd-9275-4913-8766-58bdb349e570" released by "delete_volume" :: held 2.253s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Created reservations ['e0d00553-1797-4f33-9bde-fb05ada7534e', 'e655c62a-4215-46be-9281-a232057074f0', '50931486-0d7f-4d31-bd59-c42797ef7fe7', '5661654a-56c5-4fec-8b61-6d6a50b6eed7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:44:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:06 devstack sudo[90021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:44:06 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:07 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:07 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:44:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Deleted volume successfully.
Jun 01 01:44:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b498baf-7565-49ff-8348-28d4880fd861 tempest-TaggedAttachmentsTest-2102536684 None] Lock "cinder-719452cd-9275-4913-8766-58bdb349e570-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:44:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-0df78f52-8db9-4c9f-80e5-361bb4c7bffc req-15315362-6f3b-485b-ab81-c3a22e412607 tempest-ServerActionsTestOtherA-1291260540 None] Terminate volume connection completed successfully.
Jun 01 01:44:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0df78f52-8db9-4c9f-80e5-361bb4c7bffc req-15315362-6f3b-485b-ab81-c3a22e412607 tempest-ServerActionsTestOtherA-1291260540 None] Deleting attachment 6745703f-8107-46c0-b4e4-dd43abcb5bb1. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:44:20 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=44,cinder:UPDATE=34,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:44:20 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=47,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:44:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Acquiring lock "cinder-65d608e3-02cb-4af4-9e43-05c2c067a636-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:44:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Lock "cinder-65d608e3-02cb-4af4-9e43-05c2c067a636-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:44:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Acquiring lock "cinder-quobyte-65d608e3-02cb-4af4-9e43-05c2c067a636" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:44:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Lock "cinder-quobyte-65d608e3-02cb-4af4-9e43-05c2c067a636" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:44:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb640e-e161-4697-8e2d-b645dd06e5f9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:44:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:21 devstack sudo[90116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636
Jun 01 01:44:21 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:22 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636" returned: 0 in 0.761s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:22 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636
Jun 01 01:44:22 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:23 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65d608e3-02cb-4af4-9e43-05c2c067a636" returned: 0 in 1.201s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Lock "cinder-quobyte-65d608e3-02cb-4af4-9e43-05c2c067a636" released by "delete_volume" :: held 2.022s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Created reservations ['798e209b-09d7-4e23-88ab-52f1b35a1b80', 'd0168ad9-fadf-44e3-beea-14ac3b9186e4', '93fbe3c1-b516-4a71-89fe-eefee5c4a987', '37622f71-a50d-456f-b526-9f1f4193d583'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:44:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:24 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:44:24 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:24 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.007s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:25 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:44:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Deleted volume successfully.
Jun 01 01:44:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05684be9-07d0-4e16-86ce-5d5b59d6800e tempest-ServerActionsTestOtherA-1291260540 None] Lock "cinder-65d608e3-02cb-4af4-9e43-05c2c067a636-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:44:33 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:44:35 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Flow 'volume_create_manager' (f2491e6f-b8d3-4782-b756-36e3fc6660ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52e73eb-6c8f-4278-926b-ed880fabdb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52e73eb-6c8f-4278-926b-ed880fabdb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1718695360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55d206f-9c21-4744-b8f0-dc1843ae298b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='86a7b98c85664ea293326b4c6b17cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:44:48Z,use_quota=True,user_id='4064a34be79e470a982e451f88ee69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7992f4e-b041-4047-9659-3c3574db0072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7992f4e-b041-4047-9659-3c3574db0072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08821204-b8ab-4403-a4fc-479acc059639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08821204-b8ab-4403-a4fc-479acc059639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55d206f-9c21-4744-b8f0-dc1843ae298b', 'volume_name': 'volume-f55d206f-9c21-4744-b8f0-dc1843ae298b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f69bf-0423-45cb-be8a-162421c85a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f69bf-0423-45cb-be8a-162421c85a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cded87c-0ff4-458e-a41e-194407d8f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:44:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Volume f55d206f-9c21-4744-b8f0-dc1843ae298b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55d206f-9c21-4744-b8f0-dc1843ae298b', 'volume_size': 1}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1718695360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55d206f-9c21-4744-b8f0-dc1843ae298b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='86a7b98c85664ea293326b4c6b17cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:44:48Z,use_quota=True,user_id='4064a34be79e470a982e451f88ee69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Creating volume f55d206f-9c21-4744-b8f0-dc1843ae298b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:44:48 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:44:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:48 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b 1073741824
Jun 01 01:44:48 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:49 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b 1073741824" returned: 0 in 1.290s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:49 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b
Jun 01 01:44:49 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:50 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b" returned: 0 in 0.722s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:44:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:44:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cded87c-0ff4-458e-a41e-194407d8f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55d206f-9c21-4744-b8f0-dc1843ae298b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:44:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb9b4ac-0805-41fc-87d9-2c5442de9dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:44:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Volume volume-f55d206f-9c21-4744-b8f0-dc1843ae298b (f55d206f-9c21-4744-b8f0-dc1843ae298b): created successfully
Jun 01 01:44:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb9b4ac-0805-41fc-87d9-2c5442de9dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:44:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Flow 'volume_create_manager' (f2491e6f-b8d3-4782-b756-36e3fc6660ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:44:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-92cf6cc9-ca81-434c-bda0-5bf9ad062eaf req-7bf56bb3-5f48-4cb3-a894-a55fa63ed1d4 tempest-VolumesGetTestJSON-1409082331 None] Created volume successfully.
Jun 01 01:44:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Acquiring lock "cinder-f55d206f-9c21-4744-b8f0-dc1843ae298b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:44:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Lock "cinder-f55d206f-9c21-4744-b8f0-dc1843ae298b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:44:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Acquiring lock "cinder-quobyte-f55d206f-9c21-4744-b8f0-dc1843ae298b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:44:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Lock "cinder-quobyte-f55d206f-9c21-4744-b8f0-dc1843ae298b" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:44:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16b1ddd-9160-40bb-9d72-6dad17fa7a6f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:44:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:52 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b
Jun 01 01:44:52 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:44:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:44:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:44:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:44:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:44:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:44:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:52 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:44:52 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:53 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b" returned: 0 in 1.156s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:53 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b
Jun 01 01:44:53 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:53 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.874s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:44:53 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f55d206f-9c21-4744-b8f0-dc1843ae298b" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Lock "cinder-quobyte-f55d206f-9c21-4744-b8f0-dc1843ae298b" released by "delete_volume" :: held 1.901s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG cinder.quota [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Created reservations ['c5e51b15-9b98-437f-9c2c-0bcd94298d25', '83b642b8-bfcf-4cc0-a37a-351da846c81b', '229baa40-3cee-4792-b522-e91e63954599', 'e4ec7099-e80b-4427-aeba-10864fc8d60b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:44:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:44:53 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:44:53 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:44:54 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Jun 01 01:44:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.059s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:44:54 devstack cinder-volume[86676]: DEBUG cinder.manager [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:44:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Deleted volume successfully.
Jun 01 01:44:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-01df5faf-43c2-4d86-b6b7-386c04be33c3 req-d783b1e6-5b25-43a6-af74-acae21ddc02b tempest-VolumesGetTestJSON-1409082331 None] Lock "cinder-f55d206f-9c21-4744-b8f0-dc1843ae298b-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:45:00 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:45:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Flow 'volume_create_manager' (65575f9e-7f27-4a4e-a1dc-2c178235071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660461af-b8b6-4a7d-a244-cd007d8df8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660461af-b8b6-4a7d-a244-cd007d8df8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1027879443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51fc7b6-9c83-4dd8-a848-516e82bb5889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7490fd4d9114172ae53a541f3fe68d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:01Z,use_quota=True,user_id='a5f579b44012421cb86c1506e1a46fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0aad38-2e01-4395-a1bf-e11596dfa5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0aad38-2e01-4395-a1bf-e11596dfa5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8538dbfc-c8db-406d-a5c7-13fd5afbf83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8538dbfc-c8db-406d-a5c7-13fd5afbf83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51fc7b6-9c83-4dd8-a848-516e82bb5889', 'volume_name': 'volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c15903d-448a-45bb-a4dd-fcd43e1bbd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c15903d-448a-45bb-a4dd-fcd43e1bbd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3524931-26a4-4643-8258-48bdb46d9180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Volume d51fc7b6-9c83-4dd8-a848-516e82bb5889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889', 'volume_size': 1}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1027879443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51fc7b6-9c83-4dd8-a848-516e82bb5889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7490fd4d9114172ae53a541f3fe68d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:01Z,use_quota=True,user_id='a5f579b44012421cb86c1506e1a46fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Creating volume d51fc7b6-9c83-4dd8-a848-516e82bb5889 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:45:01 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:45:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:01 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889 1073741824
Jun 01 01:45:01 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:02 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889 1073741824" returned: 0 in 1.407s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:02 devstack sudo[90675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889
Jun 01 01:45:02 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:03 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889" returned: 0 in 0.904s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] <== create_volume: return (2404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:45:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3524931-26a4-4643-8258-48bdb46d9180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8173a3fe-d4cf-4339-9724-058231666520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:03 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Volume volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889 (d51fc7b6-9c83-4dd8-a848-516e82bb5889): created successfully
Jun 01 01:45:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8173a3fe-d4cf-4339-9724-058231666520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Flow 'volume_create_manager' (65575f9e-7f27-4a4e-a1dc-2c178235071a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-73802ac2-c23e-4460-97a0-98523d8dca8f tempest-ServersNegativeTestJSON-131125604 None] Created volume successfully.
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Flow 'volume_create_manager' (56a1d479-9c01-4696-b4c0-4930bb2fb054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ef43da-152d-49d7-bfe9-7b61b04db83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ef43da-152d-49d7-bfe9-7b61b04db83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1588202370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c48a56-9b08-4df9-9055-bf7c9a48e954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7490fd4d9114172ae53a541f3fe68d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:06Z,use_quota=True,user_id='a5f579b44012421cb86c1506e1a46fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecbba3c-21f4-42fc-a4e6-86bebd325a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecbba3c-21f4-42fc-a4e6-86bebd325a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ad55d5-e252-429c-9bab-8444519b6f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ad55d5-e252-429c-9bab-8444519b6f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c48a56-9b08-4df9-9055-bf7c9a48e954', 'volume_name': 'volume-22c48a56-9b08-4df9-9055-bf7c9a48e954', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4a2736-a590-4101-a2cd-a5c1a0c45cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4a2736-a590-4101-a2cd-a5c1a0c45cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ad3a5b-c9df-4d97-af16-da8408480556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:06 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Volume 22c48a56-9b08-4df9-9055-bf7c9a48e954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c48a56-9b08-4df9-9055-bf7c9a48e954', 'volume_size': 1}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1588202370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c48a56-9b08-4df9-9055-bf7c9a48e954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7490fd4d9114172ae53a541f3fe68d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:06Z,use_quota=True,user_id='a5f579b44012421cb86c1506e1a46fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Creating volume 22c48a56-9b08-4df9-9055-bf7c9a48e954 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:45:06 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:45:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:06 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954 1073741824
Jun 01 01:45:06 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-0a87d08c-a9d9-41b0-9db9-f964fd360dc0 req-4bd98db8-fcf8-49ae-be91-937ad1dcaaef tempest-AttachVolumeNegativeTest-2081389715 None] Terminate volume connection completed successfully.
Jun 01 01:45:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-0a87d08c-a9d9-41b0-9db9-f964fd360dc0 req-4bd98db8-fcf8-49ae-be91-937ad1dcaaef tempest-AttachVolumeNegativeTest-2081389715 None] Deleting attachment 51ef83c3-2fc0-49df-8c1d-76f79d1fafb3. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:45:07 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954 1073741824" returned: 0 in 1.050s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:07 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954
Jun 01 01:45:07 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:08 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ad3a5b-c9df-4d97-af16-da8408480556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c48a56-9b08-4df9-9055-bf7c9a48e954', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25e5ce4-8863-4156-8777-e6ba9714bad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Volume volume-22c48a56-9b08-4df9-9055-bf7c9a48e954 (22c48a56-9b08-4df9-9055-bf7c9a48e954): created successfully
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25e5ce4-8863-4156-8777-e6ba9714bad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Flow 'volume_create_manager' (56a1d479-9c01-4696-b4c0-4930bb2fb054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-76c9a05d-a086-4d28-b1ad-79fbe9335786 tempest-ServersNegativeTestJSON-131125604 None] Created volume successfully.
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "cinder-22c48a56-9b08-4df9-9055-bf7c9a48e954-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-22c48a56-9b08-4df9-9055-bf7c9a48e954-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "cinder-quobyte-22c48a56-9b08-4df9-9055-bf7c9a48e954" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-quobyte-22c48a56-9b08-4df9-9055-bf7c9a48e954" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83d063-3ee4-4f71-bf8a-26e36403572f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:45:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:09 devstack sudo[90693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954
Jun 01 01:45:09 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:10 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954" returned: 0 in 0.984s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:10 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954
Jun 01 01:45:10 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:10 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-22c48a56-9b08-4df9-9055-bf7c9a48e954" returned: 0 in 0.948s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-quobyte-22c48a56-9b08-4df9-9055-bf7c9a48e954" released by "delete_volume" :: held 2.006s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Created reservations ['97e2db6e-4c8a-47de-a9f1-0b3d41ee0444', '511b0d1c-e869-41ba-9a7e-9b59750bd204', '88e5dd7a-d97e-441f-b1f9-8420f6798528', 'd0858c32-a779-463a-9275-49d1d48dcfb9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:11 devstack sudo[90739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:45:11 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:12 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.766s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:45:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Deleted volume successfully.
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7b753376-e600-43b1-a638-31892090cf55 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-22c48a56-9b08-4df9-9055-bf7c9a48e954-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "cinder-d51fc7b6-9c83-4dd8-a848-516e82bb5889-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-d51fc7b6-9c83-4dd8-a848-516e82bb5889-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "cinder-quobyte-d51fc7b6-9c83-4dd8-a848-516e82bb5889" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-quobyte-d51fc7b6-9c83-4dd8-a848-516e82bb5889" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[160abf50-b6bf-4599-a50f-8ef5ce2a2ba4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:45:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:12 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889
Jun 01 01:45:12 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:13 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889" returned: 0 in 0.868s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:13 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889
Jun 01 01:45:13 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:13 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d51fc7b6-9c83-4dd8-a848-516e82bb5889" returned: 0 in 0.669s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-quobyte-d51fc7b6-9c83-4dd8-a848-516e82bb5889" released by "delete_volume" :: held 1.610s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Created reservations ['33163b38-62c5-4f72-8e27-06e8129ecb26', '524358b2-1583-41b3-a024-3d331d880ea3', '5a88e7f6-2958-48c3-bfb4-190320904b4a', '5c905ecd-840d-4dfa-88ff-c5b208167677'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:14 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:45:14 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:14 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.603s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:45:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Deleted volume successfully.
Jun 01 01:45:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61fe6c89-22ed-4e2b-b7af-f592713eed39 tempest-ServersNegativeTestJSON-131125604 None] Lock "cinder-d51fc7b6-9c83-4dd8-a848-516e82bb5889-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Flow 'volume_create_manager' (ac7c5574-16f9-4a54-843a-54c00172a084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a8d44c-13fa-4221-bb7d-2316cbfcb7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a8d44c-13fa-4221-bb7d-2316cbfcb7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-354507575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14218811-7a1c-4e93-9bf3-42322e494f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19655bde2be54d93bf9a937fff988432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:24Z,use_quota=True,user_id='5e54452fc58d43c29f4596e411161ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87af2e10-784c-4f50-ac6a-eb3c8d0adfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87af2e10-784c-4f50-ac6a-eb3c8d0adfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799e7e04-96de-49a5-b6bd-1c81fcfacc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799e7e04-96de-49a5-b6bd-1c81fcfacc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14218811-7a1c-4e93-9bf3-42322e494f42', 'volume_name': 'volume-14218811-7a1c-4e93-9bf3-42322e494f42', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4063be4-fbc0-43f2-9d82-3c9d48f88b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4063be4-fbc0-43f2-9d82-3c9d48f88b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c57149-a274-48ce-805a-7aec47ef5e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Volume 14218811-7a1c-4e93-9bf3-42322e494f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14218811-7a1c-4e93-9bf3-42322e494f42', 'volume_size': 1}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-354507575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14218811-7a1c-4e93-9bf3-42322e494f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19655bde2be54d93bf9a937fff988432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:24Z,use_quota=True,user_id='5e54452fc58d43c29f4596e411161ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Creating volume 14218811-7a1c-4e93-9bf3-42322e494f42 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:45:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:45:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:24 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42 1073741824
Jun 01 01:45:24 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:25 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42 1073741824" returned: 0 in 0.981s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:25 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42
Jun 01 01:45:25 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:26 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:45:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c57149-a274-48ce-805a-7aec47ef5e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14218811-7a1c-4e93-9bf3-42322e494f42', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cefe220-baf5-41a5-9351-624b54d5e295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Volume volume-14218811-7a1c-4e93-9bf3-42322e494f42 (14218811-7a1c-4e93-9bf3-42322e494f42): created successfully
Jun 01 01:45:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cefe220-baf5-41a5-9351-624b54d5e295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Flow 'volume_create_manager' (ac7c5574-16f9-4a54-843a-54c00172a084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6e5d679c-dbc0-4d52-82c9-759a04f99706 tempest-AttachVolumeTestJSON-1803960860 None] Created volume successfully.
Jun 01 01:45:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-4b74b836-5e47-418b-acef-df3ba73e0eca req-8c8d5e2f-b22a-47be-a0b5-f30563c63c7b tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-4b74b836-5e47-418b-acef-df3ba73e0eca req-8c8d5e2f-b22a-47be-a0b5-f30563c63c7b tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74af8f7b-8c78-4618-b913-f40dc6a4d9a8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:45:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-4b74b836-5e47-418b-acef-df3ba73e0eca req-8c8d5e2f-b22a-47be-a0b5-f30563c63c7b tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:29 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42
Jun 01 01:45:29 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:30 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-4b74b836-5e47-418b-acef-df3ba73e0eca req-8c8d5e2f-b22a-47be-a0b5-f30563c63c7b tempest-AttachVolumeTestJSON-1803960860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42" returned: 0 in 0.777s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-4b74b836-5e47-418b-acef-df3ba73e0eca req-8c8d5e2f-b22a-47be-a0b5-f30563c63c7b tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-4b74b836-5e47-418b-acef-df3ba73e0eca req-8c8d5e2f-b22a-47be-a0b5-f30563c63c7b tempest-AttachVolumeTestJSON-1803960860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-14218811-7a1c-4e93-9bf3-42322e494f42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0c95814-6c42-4bfb-b89b-a85a129d86a0', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:45:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-4b74b836-5e47-418b-acef-df3ba73e0eca req-8c8d5e2f-b22a-47be-a0b5-f30563c63c7b tempest-AttachVolumeTestJSON-1803960860 None] attachment_update completed successfully.
Jun 01 01:45:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:45:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Flow 'volume_create_manager' (51f6cb2d-2d1e-4cfd-8c8b-0543eb54d604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8e1f95-528b-43aa-98e4-feafcf2eadb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8e1f95-528b-43aa-98e4-feafcf2eadb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-496436855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba41a003-26eb-4219-84fb-de71b36d1a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa07598d085d4345859c751543e97e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:35Z,use_quota=True,user_id='c6a93c573004447090a69578b1d5abdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd04e96c-9e16-410e-9779-7aa239690b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd04e96c-9e16-410e-9779-7aa239690b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e006d9-1fa0-4e1d-9230-9b6f58f66a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e006d9-1fa0-4e1d-9230-9b6f58f66a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba41a003-26eb-4219-84fb-de71b36d1a0c', 'volume_name': 'volume-ba41a003-26eb-4219-84fb-de71b36d1a0c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b817d44-6900-4837-8ca4-ae5e647e98ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b817d44-6900-4837-8ca4-ae5e647e98ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b363ca4-8c3b-4901-b5c9-eb19b3079d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Volume ba41a003-26eb-4219-84fb-de71b36d1a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba41a003-26eb-4219-84fb-de71b36d1a0c', 'volume_size': 1}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-496436855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba41a003-26eb-4219-84fb-de71b36d1a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa07598d085d4345859c751543e97e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:35Z,use_quota=True,user_id='c6a93c573004447090a69578b1d5abdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Creating volume ba41a003-26eb-4219-84fb-de71b36d1a0c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:45:35 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:45:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:35 devstack sudo[91287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c 1073741824
Jun 01 01:45:35 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:36 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c 1073741824" returned: 0 in 1.340s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:36 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c
Jun 01 01:45:36 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:37 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c" returned: 0 in 1.198s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] <== create_volume: return (2644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:45:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b363ca4-8c3b-4901-b5c9-eb19b3079d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba41a003-26eb-4219-84fb-de71b36d1a0c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efdb734-7dfd-4aec-a031-b066d41025df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Volume volume-ba41a003-26eb-4219-84fb-de71b36d1a0c (ba41a003-26eb-4219-84fb-de71b36d1a0c): created successfully
Jun 01 01:45:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efdb734-7dfd-4aec-a031-b066d41025df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Flow 'volume_create_manager' (51f6cb2d-2d1e-4cfd-8c8b-0543eb54d604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-61b16fa1-a190-4db5-b553-0af4090b75e4 tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Created volume successfully.
Jun 01 01:45:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Acquiring lock "cinder-ba41a003-26eb-4219-84fb-de71b36d1a0c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "cinder-ba41a003-26eb-4219-84fb-de71b36d1a0c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Acquiring lock "cinder-quobyte-ba41a003-26eb-4219-84fb-de71b36d1a0c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "cinder-quobyte-ba41a003-26eb-4219-84fb-de71b36d1a0c" acquired by "delete_volume" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:40 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3d24ba-3304-4ba5-b982-64f7cc6954d1]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:45:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:40 devstack sudo[91380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c
Jun 01 01:45:40 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:41 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c" returned: 0 in 1.093s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:41 devstack sudo[91385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c
Jun 01 01:45:41 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:42 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ba41a003-26eb-4219-84fb-de71b36d1a0c" returned: 0 in 0.976s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "cinder-quobyte-ba41a003-26eb-4219-84fb-de71b36d1a0c" released by "delete_volume" :: held 2.155s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Created reservations ['94864cda-caa4-42c9-97ec-2c7cba17f12d', 'ba8d0356-3406-45f6-bf62-36f77b828da9', '8d727f66-159b-4974-bdf9-6643aa756731', '999c74b1-07cd-4e21-bafa-c1302d5ab549'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:42 devstack sudo[91389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:45:42 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:43 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.096s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:43 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:45:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Deleted volume successfully.
Jun 01 01:45:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1172fab4-11c0-47b8-bb40-bf736e16bd5b tempest-VolumeQuotasNegativeTestJSON-1118556943 None] Lock "cinder-ba41a003-26eb-4219-84fb-de71b36d1a0c-delete_volume" released by "delete_volume" :: held 3.798s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=36,cinder:UPDATE=53,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=38,cinder:UPDATE=45,cinder:DELETE=5,cinder:INSERT=8 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Flow 'volume_create_manager' (4818113e-2cf1-41cc-aab2-a925b6ee0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d523e1-8be6-472e-abb6-bd315b1b557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d523e1-8be6-472e-abb6-bd315b1b557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-586886579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee66af19-9119-4e4b-ba99-21632a7980dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cb4b66ea2d4aef88d67ac08e17030e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:51Z,use_quota=True,user_id='55908d8c862f46188662255d787d3805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bb60e4-73bd-461a-bf3e-f02b0b64d3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bb60e4-73bd-461a-bf3e-f02b0b64d3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0438d868-f8d9-4692-be6c-3a7e3731efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0438d868-f8d9-4692-be6c-3a7e3731efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee66af19-9119-4e4b-ba99-21632a7980dd', 'volume_name': 'volume-ee66af19-9119-4e4b-ba99-21632a7980dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed862e1d-ce6f-4a28-8c7b-b9e01ae0772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed862e1d-ce6f-4a28-8c7b-b9e01ae0772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90637bd9-d403-4f8a-956e-63be2f33d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Volume ee66af19-9119-4e4b-ba99-21632a7980dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee66af19-9119-4e4b-ba99-21632a7980dd', 'volume_size': 1}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-586886579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee66af19-9119-4e4b-ba99-21632a7980dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cb4b66ea2d4aef88d67ac08e17030e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:45:51Z,use_quota=True,user_id='55908d8c862f46188662255d787d3805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Creating volume ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:45:50 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:45:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:50 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd 1073741824
Jun 01 01:45:50 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:51 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd 1073741824" returned: 0 in 0.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:51 devstack sudo[91884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd
Jun 01 01:45:51 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:52 devstack sudo[91934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:45:52 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:52 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd" returned: 0 in 0.955s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90637bd9-d403-4f8a-956e-63be2f33d71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee66af19-9119-4e4b-ba99-21632a7980dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6499b9c-6c12-4fd5-b70c-7d6d404fa20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:45:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Volume volume-ee66af19-9119-4e4b-ba99-21632a7980dd (ee66af19-9119-4e4b-ba99-21632a7980dd): created successfully
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6499b9c-6c12-4fd5-b70c-7d6d404fa20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:45:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Flow 'volume_create_manager' (4818113e-2cf1-41cc-aab2-a925b6ee0511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:45:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3f88a013-f57a-4a62-9aa9-ee0d5fa8a047 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Created volume successfully.
Jun 01 01:45:53 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.962s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Creating offline snapshot 96f3e66d-c053-4839-b151-f50182f874ce of volume ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[698a3084-7f98-452a-a7e9-7089091071c0]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:45:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:53 devstack sudo[91951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd
Jun 01 01:45:53 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:54 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd" returned: 0 in 1.220s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:54 devstack sudo[91958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce 1G
Jun 01 01:45:54 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:55 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce 1G" returned: 0 in 1.166s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee66af19-9119-4e4b-ba99-21632a7980dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:55 devstack sudo[91989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee66af19-9119-4e4b-ba99-21632a7980dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce
Jun 01 01:45:55 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:56 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee66af19-9119-4e4b-ba99-21632a7980dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce" returned: 0 in 0.756s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:56 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce is being set with open permissions: ugo+rw
Jun 01 01:45:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:56 devstack sudo[91996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce
Jun 01 01:45:56 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:57 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce" returned: 0 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:57 devstack sudo[91999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.info
Jun 01 01:45:57 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:57 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.info" returned: 0 in 0.621s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:57 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.info is being set with open permissions: ugo+rw
Jun 01 01:45:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:57 devstack sudo[92002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.info
Jun 01 01:45:57 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:45:58 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root
Jun 01 01:45:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.info" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:45:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.293s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:45:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-41b3cac8-93f0-4d4c-9123-3fccae9758d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Create snapshot completed successfully
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "cinder-96f3e66d-c053-4839-b151-f50182f874ce-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-96f3e66d-c053-4839-b151-f50182f874ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "cinder-quobyte-ee66af19-9119-4e4b-ba99-21632a7980dd" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-quobyte-ee66af19-9119-4e4b-ba99-21632a7980dd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "cinder-quobyte-96f3e66d-c053-4839-b151-f50182f874ce" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-quobyte-96f3e66d-c053-4839-b151-f50182f874ce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Deleting offline snapshot 96f3e66d-c053-4839-b151-f50182f874ce of volume ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] snapshot_file for this snap is: volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c059cb7-10ba-4240-b35f-9d7dce4dc3fe]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:45:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:45:59 devstack sudo[92009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce
Jun 01 01:45:59 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:00 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce" returned: 0 in 1.355s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee66af19-9119-4e4b-ba99-21632a7980dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:46:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf107e-c68a-47e9-aca8-dbeee383870c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:46:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:00 devstack sudo[92075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd
Jun 01 01:46:00 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:01 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd" returned: 0 in 0.876s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:01 devstack sudo[92083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce
Jun 01 01:46:01 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:02 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:02 devstack sudo[92088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce
Jun 01 01:46:02 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:03 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd.96f3e66d-c053-4839-b151-f50182f874ce" returned: 0 in 0.881s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-quobyte-96f3e66d-c053-4839-b151-f50182f874ce" released by "_delete_snapshot" :: held 4.162s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-quobyte-ee66af19-9119-4e4b-ba99-21632a7980dd" released by "delete_snapshot" :: held 4.191s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:46:03 devstack cinder-volume[86676]: WARNING cinder.quota [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Created reservations ['35f4c273-13db-476e-ba49-04f8d51d4fe4', 'f2708201-8112-47b5-99c2-6d16d5535b89', '43a21196-0140-4d11-8358-40a0432a985b', '35533377-f2a8-4566-8962-07187ffabb26'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Flow 'volume_create_manager' (40ac33b7-7aee-4b08-906c-972c6b01b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127d786-82ad-420c-a271-49d281c57c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127d786-82ad-420c-a271-49d281c57c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1401045280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78466a00-880a-462f-82c1-0e31cba6133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e8e8d75773462b9b90bb7deb9d3b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:46:03Z,use_quota=True,user_id='6756495a57bc4e22bc32db9f94da6715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cd4b08-1f93-4886-bce6-48ba8ae1ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cd4b08-1f93-4886-bce6-48ba8ae1ee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafad467-ad2d-4315-b3a2-51551d5980c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafad467-ad2d-4315-b3a2-51551d5980c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78466a00-880a-462f-82c1-0e31cba6133e', 'volume_name': 'volume-78466a00-880a-462f-82c1-0e31cba6133e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600610c6-ea83-4ee3-80b5-dd60618eca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600610c6-ea83-4ee3-80b5-dd60618eca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9998612-7fe0-4ea0-9adc-1b87b27f4826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:03 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Volume 78466a00-880a-462f-82c1-0e31cba6133e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78466a00-880a-462f-82c1-0e31cba6133e', 'volume_size': 1}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1401045280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78466a00-880a-462f-82c1-0e31cba6133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e8e8d75773462b9b90bb7deb9d3b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:46:03Z,use_quota=True,user_id='6756495a57bc4e22bc32db9f94da6715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Creating volume 78466a00-880a-462f-82c1-0e31cba6133e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:46:03 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:03 devstack sudo[92094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e 1073741824
Jun 01 01:46:03 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Delete snapshot completed successfully.
Jun 01 01:46:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8bd85440-a6e8-4054-b894-c2d6c597bc32 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-96f3e66d-c053-4839-b151-f50182f874ce-delete_snapshot" released by "delete_snapshot" :: held 4.542s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:46:04 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e 1073741824" returned: 0 in 1.051s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "cinder-ee66af19-9119-4e4b-ba99-21632a7980dd-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:46:04 devstack sudo[92100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e
Jun 01 01:46:04 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-ee66af19-9119-4e4b-ba99-21632a7980dd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:46:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "cinder-quobyte-ee66af19-9119-4e4b-ba99-21632a7980dd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:46:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-quobyte-ee66af19-9119-4e4b-ba99-21632a7980dd" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7cbcd-6668-4de3-bd39-eb4acb44ba47]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:05 devstack sudo[92102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd
Jun 01 01:46:05 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:05 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e" returned: 0 in 0.990s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9998612-7fe0-4ea0-9adc-1b87b27f4826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78466a00-880a-462f-82c1-0e31cba6133e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a258b0-4ad1-42e1-b60f-be05546f3c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:05 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Volume volume-78466a00-880a-462f-82c1-0e31cba6133e (78466a00-880a-462f-82c1-0e31cba6133e): created successfully
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a258b0-4ad1-42e1-b60f-be05546f3c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:05 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Flow 'volume_create_manager' (40ac33b7-7aee-4b08-906c-972c6b01b07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:46:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-553e5215-7cff-4499-9cdc-4a6e3e0cbbba tempest-AttachVolumeNegativeTest-2081389715 None] Created volume successfully.
Jun 01 01:46:06 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd" returned: 0 in 1.222s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:06 devstack sudo[92109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd
Jun 01 01:46:06 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:06 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ee66af19-9119-4e4b-ba99-21632a7980dd" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-quobyte-ee66af19-9119-4e4b-ba99-21632a7980dd" released by "delete_volume" :: held 2.001s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Created reservations ['840bbadf-9b8c-4a45-aaeb-f97219895350', '25e7ac54-dd2d-44e4-977a-582dd5f6842c', '9b1f4a9f-e8d9-41d6-a54a-e85c93f4caa0', 'bdd06dc0-9ec7-4268-8ff7-66f3165c9d3b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:07 devstack sudo[92121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:46:07 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:07 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.782s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:46:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Deleted volume successfully.
Jun 01 01:46:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85545f3f-719b-43ad-8f90-b00544e112c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-874623360 None] Lock "cinder-ee66af19-9119-4e4b-ba99-21632a7980dd-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:46:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-af9f62d1-a85d-453d-8c06-f43155cc2b63 req-92249f70-7e4a-4abf-96a3-b50351348263 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-af9f62d1-a85d-453d-8c06-f43155cc2b63 req-92249f70-7e4a-4abf-96a3-b50351348263 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdbc8e0-c68e-4c2a-80ee-b4849dec3724]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:46:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-af9f62d1-a85d-453d-8c06-f43155cc2b63 req-92249f70-7e4a-4abf-96a3-b50351348263 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:10 devstack sudo[92157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e
Jun 01 01:46:10 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:10 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-af9f62d1-a85d-453d-8c06-f43155cc2b63 req-92249f70-7e4a-4abf-96a3-b50351348263 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e" returned: 0 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-af9f62d1-a85d-453d-8c06-f43155cc2b63 req-92249f70-7e4a-4abf-96a3-b50351348263 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-af9f62d1-a85d-453d-8c06-f43155cc2b63 req-92249f70-7e4a-4abf-96a3-b50351348263 tempest-AttachVolumeNegativeTest-2081389715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-78466a00-880a-462f-82c1-0e31cba6133e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d29cf6f-5fde-48a0-8c03-0caca9aac44b', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:46:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-af9f62d1-a85d-453d-8c06-f43155cc2b63 req-92249f70-7e4a-4abf-96a3-b50351348263 tempest-AttachVolumeNegativeTest-2081389715 None] attachment_update completed successfully.
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Flow 'volume_create_manager' (66ead5b0-17fe-491e-bdf3-7cc894ef30e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8847a631-8522-49d1-b4ec-ca852188f783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8847a631-8522-49d1-b4ec-ca852188f783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1716243032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7a911a-4219-409f-a42b-a78dc226d082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb76366148fc4bf59e2c5693c6781245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:46:14Z,use_quota=True,user_id='e2fe58b29a964ff5bc061e773dad6634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d97427-1fc6-4822-b2d9-80fb1c846401),volume_type_id=26d97427-1fc6-4822-b2d9-80fb1c846401)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ca7b25-d642-4132-b8a2-1aa195643e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ca7b25-d642-4132-b8a2-1aa195643e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591da3e8-2046-4e0b-a5e0-e481271f69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591da3e8-2046-4e0b-a5e0-e481271f69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7a911a-4219-409f-a42b-a78dc226d082', 'volume_name': 'volume-3f7a911a-4219-409f-a42b-a78dc226d082', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9881bd20-5ab9-4ee7-9154-3c861e6da854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9881bd20-5ab9-4ee7-9154-3c861e6da854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb159ecb-a68f-4322-9cd2-25896e8cba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Volume 3f7a911a-4219-409f-a42b-a78dc226d082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7a911a-4219-409f-a42b-a78dc226d082', 'volume_size': 1}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1716243032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7a911a-4219-409f-a42b-a78dc226d082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb76366148fc4bf59e2c5693c6781245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:46:14Z,use_quota=True,user_id='e2fe58b29a964ff5bc061e773dad6634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d97427-1fc6-4822-b2d9-80fb1c846401),volume_type_id=26d97427-1fc6-4822-b2d9-80fb1c846401)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Creating volume 3f7a911a-4219-409f-a42b-a78dc226d082 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:46:13 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:46:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:13 devstack sudo[92165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082 1073741824
Jun 01 01:46:13 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:14 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082 1073741824" returned: 0 in 0.915s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:14 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082
Jun 01 01:46:14 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:15 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082" returned: 0 in 0.616s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb159ecb-a68f-4322-9cd2-25896e8cba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7a911a-4219-409f-a42b-a78dc226d082', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b90b579-6d66-40cf-b2cf-bb5d4e51a8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Volume volume-3f7a911a-4219-409f-a42b-a78dc226d082 (3f7a911a-4219-409f-a42b-a78dc226d082): created successfully
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b90b579-6d66-40cf-b2cf-bb5d4e51a8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Flow 'volume_create_manager' (66ead5b0-17fe-491e-bdf3-7cc894ef30e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:46:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0e77bc68-4ed2-46c3-befe-d325d664afff tempest-VolumeTypesAccessTest-1336233913 None] Created volume successfully.
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Acquiring lock "cinder-3f7a911a-4219-409f-a42b-a78dc226d082-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Lock "cinder-3f7a911a-4219-409f-a42b-a78dc226d082-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Acquiring lock "cinder-quobyte-3f7a911a-4219-409f-a42b-a78dc226d082" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Lock "cinder-quobyte-3f7a911a-4219-409f-a42b-a78dc226d082" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7e81f3-8623-478e-8e69-4f7909f022db]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:46:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:16 devstack sudo[92203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082
Jun 01 01:46:16 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:16 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:16 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082
Jun 01 01:46:16 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-afb686bd-c524-4976-820b-4029b2f6803c req-6478feb8-46d3-485c-9b13-94fba11abfaa tempest-AttachVolumeNegativeTest-2081389715 None] Terminate volume connection completed successfully.
Jun 01 01:46:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-afb686bd-c524-4976-820b-4029b2f6803c req-6478feb8-46d3-485c-9b13-94fba11abfaa tempest-AttachVolumeNegativeTest-2081389715 None] Deleting attachment 1d29cf6f-5fde-48a0-8c03-0caca9aac44b. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:46:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-5fee2a68-6a77-48d0-af08-2457ae21743a req-15804c6d-406f-435e-8ec9-ca23a67a215a tempest-AttachVolumeTestJSON-1803960860 None] Terminate volume connection completed successfully.
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-5fee2a68-6a77-48d0-af08-2457ae21743a req-15804c6d-406f-435e-8ec9-ca23a67a215a tempest-AttachVolumeTestJSON-1803960860 None] Deleting attachment c0c95814-6c42-4bfb-b89b-a85a129d86a0. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:46:17 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3f7a911a-4219-409f-a42b-a78dc226d082" returned: 0 in 0.630s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Lock "cinder-quobyte-3f7a911a-4219-409f-a42b-a78dc226d082" released by "delete_volume" :: held 1.373s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:46:17 devstack cinder-volume[86676]: WARNING cinder.quota [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1392504092 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1392504092, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:46:17 devstack cinder-volume[86676]: WARNING cinder.quota [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1392504092 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1392504092, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Created reservations ['afd56268-95d9-4c75-a07c-8e05bc644d56', '567521da-ce0b-4a0c-a8c7-59ad1e8c13c4', '47274e8e-3d76-4017-a734-cd33d7b128af', 'cabced6c-57fd-4e59-9fb2-81fc90af4659'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:17 devstack sudo[92216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:46:17 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:18 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.634s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:46:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Deleted volume successfully.
Jun 01 01:46:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-26ac7b03-f142-4815-94a2-71c4e1b86f4f tempest-VolumeTypesAccessTest-1336233913 None] Lock "cinder-3f7a911a-4219-409f-a42b-a78dc226d082-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Flow 'volume_create_manager' (2fac075a-b7bf-43c8-8f27-7e6e6bb61206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b846919-3da7-410e-ace4-3d214a67e882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b846919-3da7-410e-ace4-3d214a67e882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-356887811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d5b63d-cef4-4668-8dfb-f5ba006bb182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b524e51deb774357805ebe03fe51e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:46:27Z,use_quota=True,user_id='1f993e85b9934001993bfb4bd541f382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f743913c-f5f3-4d39-9e7e-aa96d01d950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f743913c-f5f3-4d39-9e7e-aa96d01d950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3641cb65-afea-4e05-8d29-7e24b7bac939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3641cb65-afea-4e05-8d29-7e24b7bac939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d5b63d-cef4-4668-8dfb-f5ba006bb182', 'volume_name': 'volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8216b9-a0fc-4450-8fd1-68def503a2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8216b9-a0fc-4450-8fd1-68def503a2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df632b-8545-442c-b146-776344bb6c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Volume c6d5b63d-cef4-4668-8dfb-f5ba006bb182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182', 'volume_size': 1}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-356887811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d5b63d-cef4-4668-8dfb-f5ba006bb182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b524e51deb774357805ebe03fe51e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:46:27Z,use_quota=True,user_id='1f993e85b9934001993bfb4bd541f382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Creating volume c6d5b63d-cef4-4668-8dfb-f5ba006bb182 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:46:26 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:46:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:26 devstack sudo[92334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 1073741824
Jun 01 01:46:26 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:27 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 1073741824" returned: 0 in 0.945s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:27 devstack sudo[92340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182
Jun 01 01:46:27 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:28 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182" returned: 0 in 0.722s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:46:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2df632b-8545-442c-b146-776344bb6c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd599252-5675-4a1a-855d-789b5a251393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:46:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Volume volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 (c6d5b63d-cef4-4668-8dfb-f5ba006bb182): created successfully
Jun 01 01:46:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd599252-5675-4a1a-855d-789b5a251393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:46:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Flow 'volume_create_manager' (2fac075a-b7bf-43c8-8f27-7e6e6bb61206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:46:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b37b472b-df86-4578-8cf9-805d4383e683 tempest-AttachVolumeShelveTestJSON-208892794 None] Created volume successfully.
Jun 01 01:46:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=34,cinder:UPDATE=39,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:46:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=35,cinder:INSERT=8,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c7aea22b-64a9-4751-9ddf-3685fd063139 req-ea46b36e-6060-4763-9fcc-138b4e14e77b tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c7aea22b-64a9-4751-9ddf-3685fd063139 req-ea46b36e-6060-4763-9fcc-138b4e14e77b tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bdacc3-12b6-4078-9054-cdaf86a466f4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c7aea22b-64a9-4751-9ddf-3685fd063139 req-ea46b36e-6060-4763-9fcc-138b4e14e77b tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:46:52 devstack sudo[92612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182
Jun 01 01:46:52 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:52 devstack sudo[92613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:46:52 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:46:53 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c7aea22b-64a9-4751-9ddf-3685fd063139 req-ea46b36e-6060-4763-9fcc-138b4e14e77b tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182" returned: 0 in 0.995s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c7aea22b-64a9-4751-9ddf-3685fd063139 req-ea46b36e-6060-4763-9fcc-138b4e14e77b tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-c7aea22b-64a9-4751-9ddf-3685fd063139 req-ea46b36e-6060-4763-9fcc-138b4e14e77b tempest-AttachVolumeShelveTestJSON-208892794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8f34c1e-d2b2-4020-959c-3dc381421fbf', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:46:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-c7aea22b-64a9-4751-9ddf-3685fd063139 req-ea46b36e-6060-4763-9fcc-138b4e14e77b tempest-AttachVolumeShelveTestJSON-208892794 None] attachment_update completed successfully.
Jun 01 01:46:53 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.221s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:46:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:47:03 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:47:03 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:47:14 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Flow 'volume_create_manager' (9e27995a-7602-4e75-a547-b1c82f81f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee342476-1072-4e03-9689-835de7fcdc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee342476-1072-4e03-9689-835de7fcdc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1546036434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9353a150-e921-4c25-9894-19234747a193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e8e8d75773462b9b90bb7deb9d3b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:15Z,use_quota=True,user_id='6756495a57bc4e22bc32db9f94da6715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6c9aed-a58e-41e8-a01c-8b38e7f9fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6c9aed-a58e-41e8-a01c-8b38e7f9fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9635f5f-969c-435c-96d0-2cbf107a22e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9635f5f-969c-435c-96d0-2cbf107a22e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9353a150-e921-4c25-9894-19234747a193', 'volume_name': 'volume-9353a150-e921-4c25-9894-19234747a193', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68a354b-2dda-4ff5-88ec-b1809db72dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68a354b-2dda-4ff5-88ec-b1809db72dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ded959-3744-4e53-8c6d-5619dd9a88cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Volume 9353a150-e921-4c25-9894-19234747a193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9353a150-e921-4c25-9894-19234747a193', 'volume_size': 1}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1546036434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9353a150-e921-4c25-9894-19234747a193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e8e8d75773462b9b90bb7deb9d3b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:15Z,use_quota=True,user_id='6756495a57bc4e22bc32db9f94da6715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Creating volume 9353a150-e921-4c25-9894-19234747a193 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:47:15 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:47:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:15 devstack sudo[93216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193 1073741824
Jun 01 01:47:15 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:16 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193 1073741824" returned: 0 in 0.916s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:16 devstack sudo[93223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193
Jun 01 01:47:16 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:16 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193" returned: 0 in 0.754s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ded959-3744-4e53-8c6d-5619dd9a88cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9353a150-e921-4c25-9894-19234747a193', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8744cf-a7eb-4f9f-80d8-74a8f9d620b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Volume volume-9353a150-e921-4c25-9894-19234747a193 (9353a150-e921-4c25-9894-19234747a193): created successfully
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8744cf-a7eb-4f9f-80d8-74a8f9d620b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Flow 'volume_create_manager' (9e27995a-7602-4e75-a547-b1c82f81f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4da2e67a-e866-4049-af04-c99b941ae0db tempest-AttachVolumeNegativeTest-2081389715 None] Created volume successfully.
Jun 01 01:47:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-99069cc4-e9f0-44d4-8fa1-593557dfbe43 req-c82dd6f5-a315-4d53-9b6c-e6bf5b34c470 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-99069cc4-e9f0-44d4-8fa1-593557dfbe43 req-c82dd6f5-a315-4d53-9b6c-e6bf5b34c470 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a6b353-a19e-41d8-8410-1948d171e530]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-99069cc4-e9f0-44d4-8fa1-593557dfbe43 req-c82dd6f5-a315-4d53-9b6c-e6bf5b34c470 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:21 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193
Jun 01 01:47:21 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:22 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-99069cc4-e9f0-44d4-8fa1-593557dfbe43 req-c82dd6f5-a315-4d53-9b6c-e6bf5b34c470 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193" returned: 0 in 1.505s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-99069cc4-e9f0-44d4-8fa1-593557dfbe43 req-c82dd6f5-a315-4d53-9b6c-e6bf5b34c470 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.528s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-99069cc4-e9f0-44d4-8fa1-593557dfbe43 req-c82dd6f5-a315-4d53-9b6c-e6bf5b34c470 tempest-AttachVolumeNegativeTest-2081389715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-9353a150-e921-4c25-9894-19234747a193', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eaf1b7cf-6f27-4cc4-ad20-9599c4f4dd43', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:47:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-99069cc4-e9f0-44d4-8fa1-593557dfbe43 req-c82dd6f5-a315-4d53-9b6c-e6bf5b34c470 tempest-AttachVolumeNegativeTest-2081389715 None] attachment_update completed successfully.
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (477e684f-2939-4217-a59c-5cecbbd15b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72061fa-d48f-4a58-81b6-abdbe11e2c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72061fa-d48f-4a58-81b6-abdbe11e2c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1088023868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b95348-131a-47a2-8a6f-83275d8629a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:25Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a77f59-ec03-4331-be4b-92209373a63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a77f59-ec03-4331-be4b-92209373a63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1162138-a354-4eee-8994-db16bb45766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1162138-a354-4eee-8994-db16bb45766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b95348-131a-47a2-8a6f-83275d8629a0', 'volume_name': 'volume-65b95348-131a-47a2-8a6f-83275d8629a0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8874350-7059-4d2a-8e0e-cf50009e0b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8874350-7059-4d2a-8e0e-cf50009e0b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a4cf2-ac5f-4fb7-bff8-d05bfdc87056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Volume 65b95348-131a-47a2-8a6f-83275d8629a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b95348-131a-47a2-8a6f-83275d8629a0', 'volume_size': 1}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1088023868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b95348-131a-47a2-8a6f-83275d8629a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:25Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Creating volume 65b95348-131a-47a2-8a6f-83275d8629a0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:47:25 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:47:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:25 devstack sudo[93401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0 1073741824
Jun 01 01:47:25 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:27 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0 1073741824" returned: 0 in 1.929s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:27 devstack sudo[93424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0
Jun 01 01:47:27 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:28 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0" returned: 0 in 1.030s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] <== create_volume: return (3083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:47:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.089s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a4cf2-ac5f-4fb7-bff8-d05bfdc87056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b95348-131a-47a2-8a6f-83275d8629a0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644e269f-761a-40a1-8b4a-2bf1426afe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Volume volume-65b95348-131a-47a2-8a6f-83275d8629a0 (65b95348-131a-47a2-8a6f-83275d8629a0): created successfully
Jun 01 01:47:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644e269f-761a-40a1-8b4a-2bf1426afe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (477e684f-2939-4217-a59c-5cecbbd15b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ea03bca3-71ba-495d-8a91-9d7c0b89d980 tempest-VolumesActionsTest-1584313856 None] Created volume successfully.
Jun 01 01:47:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab904ac7-c0fa-4c0f-a3a0-3b33afb4da40 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0" by "attach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab904ac7-c0fa-4c0f-a3a0-3b33afb4da40 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0" acquired by "attach_volume" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ab904ac7-c0fa-4c0f-a3a0-3b33afb4da40 tempest-VolumesActionsTest-1584313856 None] Attaching volume 65b95348-131a-47a2-8a6f-83275d8629a0 to instance c17d1968-2084-43de-9e3a-b96573d73be5 at mountpoint /dev/vdb on host None.
Jun 01 01:47:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ab904ac7-c0fa-4c0f-a3a0-3b33afb4da40 tempest-VolumesActionsTest-1584313856 None] Attach volume completed successfully.
Jun 01 01:47:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab904ac7-c0fa-4c0f-a3a0-3b33afb4da40 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0" released by "attach_volume" :: held 0.210s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-5e5c643c-0185-4f21-92c3-b3790d599456 req-6447d1fb-3270-46ca-a81c-9bdc4f577d7d tempest-AttachVolumeNegativeTest-2081389715 None] Terminate volume connection completed successfully.
Jun 01 01:47:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-5e5c643c-0185-4f21-92c3-b3790d599456 req-6447d1fb-3270-46ca-a81c-9bdc4f577d7d tempest-AttachVolumeNegativeTest-2081389715 None] Deleting attachment eaf1b7cf-6f27-4cc4-ad20-9599c4f4dd43. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:47:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9dc2add1-ac7d-4686-abc6-ad9d251f8305 tempest-VolumesActionsTest-1962050724 None] Terminate volume connection completed successfully.
Jun 01 01:47:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc2add1-ac7d-4686-abc6-ad9d251f8305 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc2add1-ac7d-4686-abc6-ad9d251f8305 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9dc2add1-ac7d-4686-abc6-ad9d251f8305 tempest-VolumesActionsTest-1962050724 None] Detaching volume 65b95348-131a-47a2-8a6f-83275d8629a0 from instance c17d1968-2084-43de-9e3a-b96573d73be5.
Jun 01 01:47:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9dc2add1-ac7d-4686-abc6-ad9d251f8305 tempest-VolumesActionsTest-1962050724 None] Detach volume completed successfully.
Jun 01 01:47:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9dc2add1-ac7d-4686-abc6-ad9d251f8305 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-185bf6bd-db31-4420-ba6f-07a0ada0fd36 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-185bf6bd-db31-4420-ba6f-07a0ada0fd36 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-185bf6bd-db31-4420-ba6f-07a0ada0fd36 tempest-VolumesActionsTest-1584313856 None] Volume detach called, but volume not attached.
Jun 01 01:47:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-185bf6bd-db31-4420-ba6f-07a0ada0fd36 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Acquiring lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Acquiring lock "cinder-quobyte-65b95348-131a-47a2-8a6f-83275d8629a0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Lock "cinder-quobyte-65b95348-131a-47a2-8a6f-83275d8629a0" acquired by "delete_volume" :: waited 0.055s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3105f6-53dd-472b-8a9c-d21571832b58]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:33 devstack sudo[93479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0
Jun 01 01:47:33 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:34 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0" returned: 0 in 1.127s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:34 devstack sudo[93508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0
Jun 01 01:47:34 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:34 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-65b95348-131a-47a2-8a6f-83275d8629a0" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Lock "cinder-quobyte-65b95348-131a-47a2-8a6f-83275d8629a0" released by "delete_volume" :: held 1.877s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:34 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Created reservations ['247ecc1c-de89-4533-9e07-ede4cd0dcdf4', 'fb026627-dba8-40a8-b973-c28e379098c8', 'b2d0f828-188b-4311-bbb4-7ef32950531e', 'e28a247d-e5b3-4f70-ba0e-65bfc49f833c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:47:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:35 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:35 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:36 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.087s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:47:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Deleted volume successfully.
Jun 01 01:47:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6c0dfdee-cd9c-4c26-92b5-7ff0d78e234f tempest-VolumesActionsTest-1584313856 None] Lock "cinder-65b95348-131a-47a2-8a6f-83275d8629a0-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-a4c06927-13ce-4684-8cea-10b524bdb10e req-674d9a30-84f3-48a6-a7c5-a021704c8fe4 tempest-AttachVolumeShelveTestJSON-208892794 None] Terminate volume connection completed successfully.
Jun 01 01:47:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-a4c06927-13ce-4684-8cea-10b524bdb10e req-674d9a30-84f3-48a6-a7c5-a021704c8fe4 tempest-AttachVolumeShelveTestJSON-208892794 None] Deleting attachment e8f34c1e-d2b2-4020-959c-3dc381421fbf. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:47:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "cinder-9353a150-e921-4c25-9894-19234747a193-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-9353a150-e921-4c25-9894-19234747a193-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "cinder-quobyte-9353a150-e921-4c25-9894-19234747a193" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-quobyte-9353a150-e921-4c25-9894-19234747a193" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f749e-9af4-4a07-8903-a391bddebb47]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:41 devstack sudo[93561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193
Jun 01 01:47:41 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:42 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193" returned: 0 in 0.787s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:42 devstack sudo[93567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193
Jun 01 01:47:42 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (ec1fdfb4-dcaa-4967-b0be-5999e798eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7feca319-d223-4c53-9d0f-0ede2b946e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7feca319-d223-4c53-9d0f-0ede2b946e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136386482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:43Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1afd10-a259-4785-b300-ef0c91e78d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1afd10-a259-4785-b300-ef0c91e78d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a073e2-e8a8-4a15-846f-b067231c05c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a073e2-e8a8-4a15-846f-b067231c05c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca', 'volume_name': 'volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a09a17-ba68-48c9-879a-c902ef9221ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a09a17-ba68-48c9-879a-c902ef9221ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83adef80-ed3e-4489-b0b7-98864c3c9384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:42 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Volume 6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca', 'volume_size': 1}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136386482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:43Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Creating volume 6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:47:42 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:47:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:42 devstack sudo[93569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca 1073741824
Jun 01 01:47:42 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:43 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9353a150-e921-4c25-9894-19234747a193" returned: 0 in 0.819s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-quobyte-9353a150-e921-4c25-9894-19234747a193" released by "delete_volume" :: held 1.659s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Created reservations ['ce1faccd-25e6-4e2c-b32c-8c0a2903fd6b', '211ad66e-0cb6-4a38-80e3-7735d7fcf8ff', '3a133c24-2263-4764-b8f0-5ae29ec3b522', '972762f6-01da-4c12-9185-daf8f269ed46'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:43 devstack sudo[93598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:43 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "cinder-78466a00-880a-462f-82c1-0e31cba6133e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-78466a00-880a-462f-82c1-0e31cba6133e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:43 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca 1073741824" returned: 0 in 0.989s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "cinder-quobyte-78466a00-880a-462f-82c1-0e31cba6133e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-quobyte-78466a00-880a-462f-82c1-0e31cba6133e" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[896427d6-bf68-4592-a77d-465996c2c993]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:43 devstack sudo[93604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca
Jun 01 01:47:43 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:43 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.678s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:47:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Deleted volume successfully.
Jun 01 01:47:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c19a0ef9-41b9-455b-953c-a3f0a797001b tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-9353a150-e921-4c25-9894-19234747a193-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:44 devstack sudo[93605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e
Jun 01 01:47:44 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:44 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca" returned: 0 in 0.777s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83adef80-ed3e-4489-b0b7-98864c3c9384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948e4c33-a835-4850-8603-d56c624ec4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Volume volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca (6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca): created successfully
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948e4c33-a835-4850-8603-d56c624ec4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (ec1fdfb4-dcaa-4967-b0be-5999e798eb94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f10c2765-51b7-4dcd-8ab7-73bea507b059 tempest-VolumesActionsTest-1584313856 None] Created volume successfully.
Jun 01 01:47:44 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e" returned: 0 in 0.996s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:44 devstack sudo[93649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e
Jun 01 01:47:44 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:45 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-78466a00-880a-462f-82c1-0e31cba6133e" returned: 0 in 0.599s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-quobyte-78466a00-880a-462f-82c1-0e31cba6133e" released by "delete_volume" :: held 1.647s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Created reservations ['b11a2242-3616-4d6c-aa2d-f97c4ff0de44', '76555e71-92b5-4ff2-ac07-e8887b89fae9', '0f4f79e2-9382-41b9-84c4-2693de537802', 'e25db443-edad-422c-96de-13f41f303452'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:45 devstack sudo[93688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:45 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-quobyte-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:46 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "cinder-efee4d77-0af5-422b-87bf-19830a3b85bd-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.701s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:47:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Deleted volume successfully.
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1f3f3-a758-4e89-973d-c93991785326]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-efee4d77-0af5-422b-87bf-19830a3b85bd-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-61768fd8-ec1c-4b98-a92c-b9cdc4283d85 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-78466a00-880a-462f-82c1-0e31cba6133e-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "cinder-quobyte-efee4d77-0af5-422b-87bf-19830a3b85bd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-quobyte-efee4d77-0af5-422b-87bf-19830a3b85bd" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:46 devstack sudo[93692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca
Jun 01 01:47:46 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5247c80-bc04-4b09-b0d4-bb5394273119]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:46 devstack sudo[93695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd
Jun 01 01:47:46 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:47 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca" returned: 0 in 0.775s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:47 devstack sudo[93701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca
Jun 01 01:47:47 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:47 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:47 devstack sudo[93705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd
Jun 01 01:47:47 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:47 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca" returned: 0 in 0.607s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca" released by "delete_volume" :: held 1.453s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Created reservations ['56eaa199-e63f-44c8-befe-10fc33bc28dd', '665b775f-c175-48a5-8104-00ffb8f818b4', 'bf04abbc-efe1-4a47-be12-3f97db764fc0', '9eaad5f5-4b64-45be-9baf-5cb2f03b0197'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:47 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-efee4d77-0af5-422b-87bf-19830a3b85bd" returned: 0 in 0.629s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:47 devstack sudo[93709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:47 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-quobyte-efee4d77-0af5-422b-87bf-19830a3b85bd" released by "delete_volume" :: held 1.404s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Created reservations ['58a074a6-e367-4eee-9238-064a5fa48da2', '94ff5295-b6ea-47f2-a113-8efb68984ea1', 'c4df057a-6a58-4f7f-b909-56c0fe691362', '61be94d6-1bff-41ce-afc0-b36d171d9683'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:48 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:48 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:48 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:47:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Deleted volume successfully.
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b8ed3dd7-adcf-4709-b22e-6893e9b6fc03 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-6068cd80-e2a7-46f3-b2ef-6a26cb30c0ca-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:48 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:47:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Deleted volume successfully.
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2b81a3c8-d625-4c58-82c1-ecaa87c49000 tempest-AttachVolumeNegativeTest-2081389715 None] Lock "cinder-efee4d77-0af5-422b-87bf-19830a3b85bd-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (cddaf242-13d2-4b23-8f32-6e386cb6407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade49fb7-abf9-467c-9881-e0f7d00e2512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade49fb7-abf9-467c-9881-e0f7d00e2512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-540912110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247a7afb-0fbc-44a1-acd0-20efbbdd35b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:49Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6839a5a1-c8dc-49e4-b805-b0fb19fb7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6839a5a1-c8dc-49e4-b805-b0fb19fb7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b72ba-957b-405e-a7c4-da7c092b8b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b72ba-957b-405e-a7c4-da7c092b8b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247a7afb-0fbc-44a1-acd0-20efbbdd35b9', 'volume_name': 'volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807369af-16dc-41bc-bf86-811f6d0e5601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807369af-16dc-41bc-bf86-811f6d0e5601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07caee0-391f-440f-a013-7324c14ee367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Volume 247a7afb-0fbc-44a1-acd0-20efbbdd35b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9', 'volume_size': 1}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-540912110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247a7afb-0fbc-44a1-acd0-20efbbdd35b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:49Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Creating volume 247a7afb-0fbc-44a1-acd0-20efbbdd35b9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:47:49 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:49 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9 1073741824
Jun 01 01:47:49 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:49 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9 1073741824" returned: 0 in 0.970s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:50 devstack sudo[93722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9
Jun 01 01:47:50 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:50 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9" returned: 0 in 0.617s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07caee0-391f-440f-a013-7324c14ee367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3d1a3e-b57e-4a07-b8c2-d282133c934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Volume volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9 (247a7afb-0fbc-44a1-acd0-20efbbdd35b9): created successfully
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3d1a3e-b57e-4a07-b8c2-d282133c934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (cddaf242-13d2-4b23-8f32-6e386cb6407b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8bb6c493-8903-48b7-a680-eb3bd0d9ff44 tempest-VolumesActionsTest-1584313856 None] Created volume successfully.
Jun 01 01:47:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-247a7afb-0fbc-44a1-acd0-20efbbdd35b9-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Lock "cinder-247a7afb-0fbc-44a1-acd0-20efbbdd35b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-quobyte-247a7afb-0fbc-44a1-acd0-20efbbdd35b9" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-247a7afb-0fbc-44a1-acd0-20efbbdd35b9" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3b996-009f-46ac-a105-8f1c71c4525c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:51 devstack sudo[93727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9
Jun 01 01:47:51 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:52 devstack sudo[93732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:52 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:52 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9" returned: 0 in 1.008s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:52 devstack sudo[93734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9
Jun 01 01:47:52 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:53 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.018s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 8 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:47:53 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Flow 'volume_create_manager' (fbc2d80d-a9f5-4050-9bf9-edb899d70add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e162ac-8441-455b-940f-e19389e1a7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-247a7afb-0fbc-44a1-acd0-20efbbdd35b9" returned: 0 in 1.086s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e162ac-8441-455b-940f-e19389e1a7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-236293461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff8c80b-c673-4b77-8388-a1311ad823b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19655bde2be54d93bf9a937fff988432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:53Z,use_quota=True,user_id='5e54452fc58d43c29f4596e411161ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd6c0d5-b41a-4147-9195-71103ef29641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd6c0d5-b41a-4147-9195-71103ef29641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4b1d2e-9ba2-40a1-811d-38ea02cb2a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4b1d2e-9ba2-40a1-811d-38ea02cb2a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff8c80b-c673-4b77-8388-a1311ad823b7', 'volume_name': 'volume-cff8c80b-c673-4b77-8388-a1311ad823b7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c398a3-6997-4d8f-8866-2c1db6594c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c398a3-6997-4d8f-8866-2c1db6594c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf87ec27-4876-416c-a790-cb876be39ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:53 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Volume cff8c80b-c673-4b77-8388-a1311ad823b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff8c80b-c673-4b77-8388-a1311ad823b7', 'volume_size': 1}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-236293461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff8c80b-c673-4b77-8388-a1311ad823b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19655bde2be54d93bf9a937fff988432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:53Z,use_quota=True,user_id='5e54452fc58d43c29f4596e411161ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Creating volume cff8c80b-c673-4b77-8388-a1311ad823b7 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:47:53 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-247a7afb-0fbc-44a1-acd0-20efbbdd35b9" released by "delete_volume" :: held 2.234s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:53 devstack sudo[93747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7 1073741824
Jun 01 01:47:53 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Created reservations ['08ed4fb9-026d-4e59-93e6-ef8a0e736ff0', '276447b3-26e7-42e9-bec5-14229d72375a', '1919be86-d62c-417c-b4aa-6d5492a72793', '7066dc96-ad42-48d8-a636-f97323cb62ec'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:53 devstack sudo[93749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:53 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:54 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.780s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:47:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Deleted volume successfully.
Jun 01 01:47:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-66ed5144-066a-452b-b41f-cf6665e7042e tempest-VolumesActionsTest-1962050724 None] Lock "cinder-247a7afb-0fbc-44a1-acd0-20efbbdd35b9-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:54 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7 1073741824" returned: 0 in 1.213s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:54 devstack sudo[93757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7
Jun 01 01:47:54 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (b0b78cfa-11f5-4772-82c3-0e71fe474036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e821865-0ecc-4676-abae-55fbe47040d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e821865-0ecc-4676-abae-55fbe47040d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1121806218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2576a6-60b0-4800-9f64-5e9d61552066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:55Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eff2ecc-82ba-40e2-9c7f-5deee4019e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eff2ecc-82ba-40e2-9c7f-5deee4019e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022e7b36-9b76-480f-b164-a6fe0589ff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022e7b36-9b76-480f-b164-a6fe0589ff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2576a6-60b0-4800-9f64-5e9d61552066', 'volume_name': 'volume-fa2576a6-60b0-4800-9f64-5e9d61552066', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f074da20-0823-4d55-a6d7-65c1e22b9a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f074da20-0823-4d55-a6d7-65c1e22b9a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9656a7da-e88c-4302-a6d9-d7617a5779f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Volume fa2576a6-60b0-4800-9f64-5e9d61552066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2576a6-60b0-4800-9f64-5e9d61552066', 'volume_size': 1}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:55 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.208s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1121806218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2576a6-60b0-4800-9f64-5e9d61552066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:47:55Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Creating volume fa2576a6-60b0-4800-9f64-5e9d61552066 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:47:55 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf87ec27-4876-416c-a790-cb876be39ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff8c80b-c673-4b77-8388-a1311ad823b7', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:55 devstack sudo[93761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066 1073741824
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aad8444-de95-4fad-9da9-8582fddaf658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:55 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Volume volume-cff8c80b-c673-4b77-8388-a1311ad823b7 (cff8c80b-c673-4b77-8388-a1311ad823b7): created successfully
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aad8444-de95-4fad-9da9-8582fddaf658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Flow 'volume_create_manager' (fbc2d80d-a9f5-4050-9bf9-edb899d70add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-17bcdef5-bb0d-4aba-a775-2f6818db17d8 tempest-AttachVolumeTestJSON-1803960860 None] Created volume successfully.
Jun 01 01:47:56 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066 1073741824" returned: 0 in 0.912s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:56 devstack sudo[93770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066
Jun 01 01:47:56 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:57 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066" returned: 0 in 0.683s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9656a7da-e88c-4302-a6d9-d7617a5779f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2576a6-60b0-4800-9f64-5e9d61552066', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbe0adc-390b-4cc1-9ce0-ae11a0fd032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:47:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Volume volume-fa2576a6-60b0-4800-9f64-5e9d61552066 (fa2576a6-60b0-4800-9f64-5e9d61552066): created successfully
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbe0adc-390b-4cc1-9ce0-ae11a0fd032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (b0b78cfa-11f5-4772-82c3-0e71fe474036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:47:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-862eb75a-b494-4cba-bd52-b47d3d3e2665 tempest-VolumesActionsTest-1584313856 None] Created volume successfully.
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-fa2576a6-60b0-4800-9f64-5e9d61552066-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-fa2576a6-60b0-4800-9f64-5e9d61552066-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-quobyte-fa2576a6-60b0-4800-9f64-5e9d61552066" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-fa2576a6-60b0-4800-9f64-5e9d61552066" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[df57d692-2b41-44bb-b88c-9e284bf4f6ae]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:57 devstack sudo[93773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066
Jun 01 01:47:57 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:58 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066" returned: 0 in 0.765s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:58 devstack sudo[93778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066
Jun 01 01:47:58 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:59 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa2576a6-60b0-4800-9f64-5e9d61552066" returned: 0 in 0.645s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-fa2576a6-60b0-4800-9f64-5e9d61552066" released by "delete_volume" :: held 1.456s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Created reservations ['6cae3b99-02d1-4f85-beb7-ee42bbee5261', '3f016b9a-3d37-47e8-9eee-d831411315bf', '41dbea69-294f-4a75-8daf-59d545648b84', 'ac098ceb-828e-4024-9409-230cc044d23a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:47:59 devstack sudo[93781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:47:59 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-3032b49a-949e-4d82-bd55-634f8e656b5e req-19f8f433-020c-4afa-8f63-a5d5aa9c20a7 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-3032b49a-949e-4d82-bd55-634f8e656b5e req-19f8f433-020c-4afa-8f63-a5d5aa9c20a7 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08470a2-b4e7-4791-a7c7-5a77da083ed7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:47:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-3032b49a-949e-4d82-bd55-634f8e656b5e req-19f8f433-020c-4afa-8f63-a5d5aa9c20a7 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:00 devstack sudo[93791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7
Jun 01 01:48:00 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:00 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Deleted volume successfully.
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4482c3c1-bdf5-41c2-b82c-157416c66b28 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-fa2576a6-60b0-4800-9f64-5e9d61552066-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (4cadff09-8b8d-4a22-8a87-750babcb5ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a2ce99-98a7-4b81-99b3-a87f5940ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a2ce99-98a7-4b81-99b3-a87f5940ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106737347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25361a9-74bb-405a-b1aa-15c7d98cd5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:00Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b19c5a4-0890-424a-ad6f-eaa733b54d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b19c5a4-0890-424a-ad6f-eaa733b54d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66f15a6-123a-445a-96e4-f2e4607358a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66f15a6-123a-445a-96e4-f2e4607358a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25361a9-74bb-405a-b1aa-15c7d98cd5d2', 'volume_name': 'volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bdad53-4966-45dd-92de-8cbb112c6646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bdad53-4966-45dd-92de-8cbb112c6646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f245ae-1250-4195-9f99-5dae4dc7069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Volume a25361a9-74bb-405a-b1aa-15c7d98cd5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2', 'volume_size': 1}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:00 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-3032b49a-949e-4d82-bd55-634f8e656b5e req-19f8f433-020c-4afa-8f63-a5d5aa9c20a7 tempest-AttachVolumeTestJSON-1803960860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7" returned: 0 in 0.886s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-3032b49a-949e-4d82-bd55-634f8e656b5e req-19f8f433-020c-4afa-8f63-a5d5aa9c20a7 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.904s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106737347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25361a9-74bb-405a-b1aa-15c7d98cd5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:00Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Creating volume a25361a9-74bb-405a-b1aa-15c7d98cd5d2 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:00 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:00 devstack sudo[93798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2 1073741824
Jun 01 01:48:00 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-3032b49a-949e-4d82-bd55-634f8e656b5e req-19f8f433-020c-4afa-8f63-a5d5aa9c20a7 tempest-AttachVolumeTestJSON-1803960860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-cff8c80b-c673-4b77-8388-a1311ad823b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29eefc8f-be1c-4c1d-ab69-89e2361a247a', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:48:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-3032b49a-949e-4d82-bd55-634f8e656b5e req-19f8f433-020c-4afa-8f63-a5d5aa9c20a7 tempest-AttachVolumeTestJSON-1803960860 None] attachment_update completed successfully.
Jun 01 01:48:01 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2 1073741824" returned: 0 in 1.111s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:02 devstack sudo[93871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2
Jun 01 01:48:02 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:02 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2" returned: 0 in 0.778s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f245ae-1250-4195-9f99-5dae4dc7069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56965344-e5e2-4907-a167-1f66c62b97cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Volume volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2 (a25361a9-74bb-405a-b1aa-15c7d98cd5d2): created successfully
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56965344-e5e2-4907-a167-1f66c62b97cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (4cadff09-8b8d-4a22-8a87-750babcb5ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c3f64ae4-bfe3-4c51-a302-89dfd85bdabd tempest-VolumesActionsTest-1584313856 None] Created volume successfully.
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-a25361a9-74bb-405a-b1aa-15c7d98cd5d2-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-a25361a9-74bb-405a-b1aa-15c7d98cd5d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "cinder-quobyte-a25361a9-74bb-405a-b1aa-15c7d98cd5d2" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-a25361a9-74bb-405a-b1aa-15c7d98cd5d2" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a478589-6a2b-49aa-b3c0-de31cc887070]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:04 devstack sudo[94207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2
Jun 01 01:48:04 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:04 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:04 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2
Jun 01 01:48:04 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:05 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a25361a9-74bb-405a-b1aa-15c7d98cd5d2" returned: 0 in 0.626s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-quobyte-a25361a9-74bb-405a-b1aa-15c7d98cd5d2" released by "delete_volume" :: held 1.428s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Created reservations ['9badcdcf-3062-4eb4-a40c-7863414f2459', '0c59fd4f-58ec-4e53-95a9-5ae72361ed46', 'c4c4f74b-dc9d-459b-ba8e-0738da866cf3', '767edf50-4ff4-4a1e-b229-9d55f9ca4ca9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:05 devstack sudo[94215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:05 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:06 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:06 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Deleted volume successfully.
Jun 01 01:48:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d205ada9-827c-448b-8427-32bc68c28da3 tempest-VolumesActionsTest-1962050724 None] Lock "cinder-a25361a9-74bb-405a-b1aa-15c7d98cd5d2-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Flow 'volume_create_manager' (d5cf0939-b5f0-49ea-ac9a-8c493c79dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3cd97d-13c1-4a96-b9cc-68a6065b69f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3cd97d-13c1-4a96-b9cc-68a6065b69f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1631660081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1d2378-dd45-42c8-9d20-62a48860096d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19655bde2be54d93bf9a937fff988432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:07Z,use_quota=True,user_id='5e54452fc58d43c29f4596e411161ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df39c67-35d6-4c71-a0b3-55f3c7b994fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df39c67-35d6-4c71-a0b3-55f3c7b994fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e23ffa-db51-4a84-94f5-1b65370ed104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e23ffa-db51-4a84-94f5-1b65370ed104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1d2378-dd45-42c8-9d20-62a48860096d', 'volume_name': 'volume-0e1d2378-dd45-42c8-9d20-62a48860096d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa7f8ac-8a1f-42ca-95c3-651c7c2bb9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa7f8ac-8a1f-42ca-95c3-651c7c2bb9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93b34dd-7e4a-4c66-af90-0d7f41861562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Volume 0e1d2378-dd45-42c8-9d20-62a48860096d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1d2378-dd45-42c8-9d20-62a48860096d', 'volume_size': 1}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1631660081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1d2378-dd45-42c8-9d20-62a48860096d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19655bde2be54d93bf9a937fff988432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:07Z,use_quota=True,user_id='5e54452fc58d43c29f4596e411161ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Creating volume 0e1d2378-dd45-42c8-9d20-62a48860096d {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:07 devstack sudo[94223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d 1073741824
Jun 01 01:48:07 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (93a0af1d-b51a-4d52-bd7f-667561c38091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a817b1-9ff1-4eca-9ebb-19fa5a81c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a817b1-9ff1-4eca-9ebb-19fa5a81c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1671696075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:07Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30da1d61-cfbd-4127-958f-aed544204e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30da1d61-cfbd-4127-958f-aed544204e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfccb3f-d8a3-4ece-94da-b7a3fc9c06d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfccb3f-d8a3-4ece-94da-b7a3fc9c06d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb', 'volume_name': 'volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123f908a-45c9-4e0a-b56b-7241fa587ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123f908a-45c9-4e0a-b56b-7241fa587ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e07a78a-f768-4b8b-8c95-ca8cfc5e5df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Volume e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb', 'volume_size': 1}
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:07 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d 1073741824" returned: 0 in 0.841s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:08 devstack sudo[94230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d
Jun 01 01:48:08 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:08 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d" returned: 0 in 0.896s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1671696075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dd66002f3647c9ac051f9063f6d96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:07Z,use_quota=True,user_id='8e9a6f4bb8ca4fbe8f1cc9fa54ffd49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Creating volume e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:08 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:08 devstack sudo[94289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb 1073741824
Jun 01 01:48:08 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93b34dd-7e4a-4c66-af90-0d7f41861562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1d2378-dd45-42c8-9d20-62a48860096d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4c2b05-dff4-4005-a68d-d845c29edbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Volume volume-0e1d2378-dd45-42c8-9d20-62a48860096d (0e1d2378-dd45-42c8-9d20-62a48860096d): created successfully
Jun 01 01:48:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4c2b05-dff4-4005-a68d-d845c29edbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Flow 'volume_create_manager' (d5cf0939-b5f0-49ea-ac9a-8c493c79dd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-73a2f8be-293c-47b0-acac-23f233f6ef2c tempest-AttachVolumeTestJSON-1803960860 None] Created volume successfully.
Jun 01 01:48:10 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb 1073741824" returned: 0 in 1.085s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:10 devstack sudo[94302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb
Jun 01 01:48:10 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:10 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb" returned: 0 in 0.914s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e07a78a-f768-4b8b-8c95-ca8cfc5e5df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c081be-df08-4097-9702-bfdefd8b292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Volume volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb (e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb): created successfully
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c081be-df08-4097-9702-bfdefd8b292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Flow 'volume_create_manager' (93a0af1d-b51a-4d52-bd7f-667561c38091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c6e0a773-8f16-4eb9-bb9d-66a524abe40b tempest-VolumesActionsTest-1584313856 None] Created volume successfully.
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Flow 'volume_create_manager' (8458549e-dfa1-4c13-86b4-1f72c8b65e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e203824-9f96-478c-b33a-bd72523c8042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e203824-9f96-478c-b33a-bd72523c8042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1846746225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c840f59f-cbb4-446b-8f66-d95108f5f445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6955aa1261f141d9a9930ddcb6f9e59d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:12Z,use_quota=True,user_id='4290bb62bf6f4a4594e3a8168ad3e2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcc4d22-d821-48c5-be76-55493dcf7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcc4d22-d821-48c5-be76-55493dcf7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d717b638-a907-40e5-bdd1-58b7be0b9fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d717b638-a907-40e5-bdd1-58b7be0b9fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c840f59f-cbb4-446b-8f66-d95108f5f445', 'volume_name': 'volume-c840f59f-cbb4-446b-8f66-d95108f5f445', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99d04f0-6cc4-4cdb-beb0-728e635a9864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99d04f0-6cc4-4cdb-beb0-728e635a9864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5bbe98-8159-40fc-b4fd-5d92be6e2b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Volume c840f59f-cbb4-446b-8f66-d95108f5f445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c840f59f-cbb4-446b-8f66-d95108f5f445', 'volume_size': 1}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1846746225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c840f59f-cbb4-446b-8f66-d95108f5f445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6955aa1261f141d9a9930ddcb6f9e59d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:12Z,use_quota=True,user_id='4290bb62bf6f4a4594e3a8168ad3e2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Creating volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:11 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:11 devstack sudo[94306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 1073741824
Jun 01 01:48:11 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "cinder-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "cinder-quobyte-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-quobyte-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ee208a-ab61-4e71-beee-eff5321eae2b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:12 devstack sudo[94308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb
Jun 01 01:48:12 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:13 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 1073741824" returned: 0 in 1.162s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:13 devstack sudo[94314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445
Jun 01 01:48:13 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:13 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb" returned: 0 in 1.237s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:13 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb
Jun 01 01:48:13 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:13 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=84,cinder:UPDATE=102,cinder:DELETE=10,cinder:INSERT=18 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:48:13 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=97,cinder:SELECT=81,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:48:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-34b2c19f-8d7a-4ec3-877e-86ead15894d3 req-c98b10fd-d8c6-4d67-9723-8d90a4866007 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:14 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445" returned: 0 in 1.007s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-34b2c19f-8d7a-4ec3-877e-86ead15894d3 req-c98b10fd-d8c6-4d67-9723-8d90a4866007 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.213s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5bbe98-8159-40fc-b4fd-5d92be6e2b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c840f59f-cbb4-446b-8f66-d95108f5f445', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b34a13-9fe8-4089-9c8b-1253c048a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[597d6868-696b-4a2c-90c0-87de96e39594]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-34b2c19f-8d7a-4ec3-877e-86ead15894d3 req-c98b10fd-d8c6-4d67-9723-8d90a4866007 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Volume volume-c840f59f-cbb4-446b-8f66-d95108f5f445 (c840f59f-cbb4-446b-8f66-d95108f5f445): created successfully
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b34a13-9fe8-4089-9c8b-1253c048a37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Flow 'volume_create_manager' (8458549e-dfa1-4c13-86b4-1f72c8b65e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-478cf486-ae81-4d69-985f-027a92490d9e tempest-SnapshotsActionsTest-1356900830 None] Created volume successfully.
Jun 01 01:48:14 devstack sudo[94332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d
Jun 01 01:48:14 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:14 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb" returned: 0 in 0.797s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-quobyte-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb" released by "delete_volume" :: held 2.093s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Created reservations ['69d057be-ed9b-4272-8337-613d6440a314', 'f38838d9-1779-4e1d-bb73-d5bd1ee735f6', 'd136b659-d96c-48d2-8318-3948581b5235', '323b6839-a121-4dce-b4fa-09bf0c4cff09'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:14 devstack sudo[94335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:14 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:15 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-34b2c19f-8d7a-4ec3-877e-86ead15894d3 req-c98b10fd-d8c6-4d67-9723-8d90a4866007 tempest-AttachVolumeTestJSON-1803960860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-34b2c19f-8d7a-4ec3-877e-86ead15894d3 req-c98b10fd-d8c6-4d67-9723-8d90a4866007 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.875s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-34b2c19f-8d7a-4ec3-877e-86ead15894d3 req-c98b10fd-d8c6-4d67-9723-8d90a4866007 tempest-AttachVolumeTestJSON-1803960860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-0e1d2378-dd45-42c8-9d20-62a48860096d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25da63cb-e251-4df1-9866-329388633149', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:48:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-34b2c19f-8d7a-4ec3-877e-86ead15894d3 req-c98b10fd-d8c6-4d67-9723-8d90a4866007 tempest-AttachVolumeTestJSON-1803960860 None] attachment_update completed successfully.
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:15 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Creating offline snapshot 02e08ff8-d877-4e34-9d8e-a67906e97e3f of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:48:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Deleted volume successfully.
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[393ee24b-8afd-4c38-b829-a06689b04eef]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-72cc92ae-0dd6-491a-873b-d1abc2bad964 tempest-VolumesActionsTest-1584313856 None] Lock "cinder-e73f2cf6-dbe5-4ffc-88ae-434c0b7e91fb-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:15 devstack sudo[94341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445
Jun 01 01:48:15 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:16 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445" returned: 0 in 0.823s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:16 devstack sudo[94348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f 1G
Jun 01 01:48:16 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:17 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f 1G" returned: 0 in 0.800s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:17 devstack sudo[94353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:17 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:17 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.696s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:17 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f is being set with open permissions: ugo+rw
Jun 01 01:48:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:17 devstack sudo[94359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:17 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:18 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.681s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:18 devstack sudo[94362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.info
Jun 01 01:48:18 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:19 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.info" returned: 0 in 0.797s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.info is being set with open permissions: ugo+rw
Jun 01 01:48:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:19 devstack sudo[94365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.info
Jun 01 01:48:19 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:20 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.info" returned: 0 in 0.864s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.777s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-66bb2a85-d777-432e-a011-78bc7d09dc5f tempest-SnapshotsActionsTest-1356900830 None] Create snapshot completed successfully
Jun 01 01:48:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Creating offline snapshot 9eb14f9e-198a-4659-b2b5-439fe8d5302c of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:48:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9a717f-3932-417e-8558-fc75ca611f9d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:21 devstack sudo[94373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:21 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-67fbc576-6737-4cca-8b1f-b1312a8c84b2 req-1e1b201f-b338-4385-9358-948fb897b5e8 tempest-AttachVolumeTestJSON-1803960860 None] Terminate volume connection completed successfully.
Jun 01 01:48:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-67fbc576-6737-4cca-8b1f-b1312a8c84b2 req-1e1b201f-b338-4385-9358-948fb897b5e8 tempest-AttachVolumeTestJSON-1803960860 None] Deleting attachment 29eefc8f-be1c-4c1d-ab69-89e2361a247a. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:48:22 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.936s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:22 devstack sudo[94420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c 1G
Jun 01 01:48:22 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:23 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c 1G" returned: 0 in 0.941s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:23 devstack sudo[94440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c
Jun 01 01:48:23 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:23 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c" returned: 0 in 0.715s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:23 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c is being set with open permissions: ugo+rw
Jun 01 01:48:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:23 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c
Jun 01 01:48:23 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:24 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.426s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-d00c4b77-8452-4379-95b5-54ec280655f6 req-7f819ffe-ddcd-4740-b828-5337e817234a tempest-AttachVolumeTestJSON-1803960860 None] Terminate volume connection completed successfully.
Jun 01 01:48:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-d00c4b77-8452-4379-95b5-54ec280655f6 req-7f819ffe-ddcd-4740-b828-5337e817234a tempest-AttachVolumeTestJSON-1803960860 None] Deleting attachment 25da63cb-e251-4df1-9866-329388633149. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:48:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-db3265e6-59d2-4c9c-983e-dc0bdf0e800e tempest-SnapshotsActionsTest-1356900830 None] Create snapshot completed successfully
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-9eb14f9e-198a-4659-b2b5-439fe8d5302c-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-9eb14f9e-198a-4659-b2b5-439fe8d5302c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-9eb14f9e-198a-4659-b2b5-439fe8d5302c" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-9eb14f9e-198a-4659-b2b5-439fe8d5302c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Deleting offline snapshot 9eb14f9e-198a-4659-b2b5-439fe8d5302c of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] snapshot_file for this snap is: volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7761b2-d509-435a-8fe3-b8a87d019cbc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:25 devstack sudo[94453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c
Jun 01 01:48:25 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:26 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c" returned: 0 in 0.779s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c39cad-3bdc-4dc1-ae76-4ae8a9c9a1d4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:26 devstack sudo[94458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:26 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:27 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.777s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:27 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c
Jun 01 01:48:27 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:28 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:28 devstack sudo[94475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c
Jun 01 01:48:28 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Flow 'volume_create_manager' (70b98642-e27a-4528-84b0-06357eff4a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0c10a0-06ac-4a2a-a14b-30eedc4e1bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0c10a0-06ac-4a2a-a14b-30eedc4e1bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-146388102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402a828c-ba72-4522-a26e-b354c8b9554b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91592389bedb4d73ba1b015d33ca98a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:28Z,use_quota=True,user_id='f9c6f3944c594cf8aea23dc3878bfdcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa30085-506f-4301-a586-c9bc2e0a2fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa30085-506f-4301-a586-c9bc2e0a2fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64d9b88-332e-4b20-b25f-bd475f59cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64d9b88-332e-4b20-b25f-bd475f59cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402a828c-ba72-4522-a26e-b354c8b9554b', 'volume_name': 'volume-402a828c-ba72-4522-a26e-b354c8b9554b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbce487-2fa1-4aaa-890f-b237a8be6d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbce487-2fa1-4aaa-890f-b237a8be6d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34302352-9c34-47f1-ab33-52e8ca34c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Volume 402a828c-ba72-4522-a26e-b354c8b9554b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402a828c-ba72-4522-a26e-b354c8b9554b', 'volume_size': 1}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-146388102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402a828c-ba72-4522-a26e-b354c8b9554b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91592389bedb4d73ba1b015d33ca98a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:28Z,use_quota=True,user_id='f9c6f3944c594cf8aea23dc3878bfdcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Creating volume 402a828c-ba72-4522-a26e-b354c8b9554b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:28 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:28 devstack sudo[94507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b 1073741824
Jun 01 01:48:28 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:29 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.9eb14f9e-198a-4659-b2b5-439fe8d5302c" returned: 0 in 1.081s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-9eb14f9e-198a-4659-b2b5-439fe8d5302c" released by "_delete_snapshot" :: held 3.538s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" released by "delete_snapshot" :: held 3.561s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:29 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Created reservations ['3a87715e-bed4-4f1c-bfc0-08ae92f314fd', '7ca4ec66-0ab7-4073-9d07-ae597b1a9fb2', 'e1803324-4b54-40bf-9351-4a04b26d70dc', '9e8c334e-236b-4e10-a02f-ec456c2789a6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Delete snapshot completed successfully.
Jun 01 01:48:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-50020ccc-f513-42fb-b30c-f58ad19ed6c1 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-9eb14f9e-198a-4659-b2b5-439fe8d5302c-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:29 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b 1073741824" returned: 0 in 1.007s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:29 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b
Jun 01 01:48:29 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:30 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b" returned: 0 in 0.899s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.341s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34302352-9c34-47f1-ab33-52e8ca34c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402a828c-ba72-4522-a26e-b354c8b9554b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6a6d13-d295-4c2a-b89a-7792690a0608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Creating offline snapshot 13c09f0b-1e91-4de6-9be7-b4ecc5effe43 of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:48:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Volume volume-402a828c-ba72-4522-a26e-b354c8b9554b (402a828c-ba72-4522-a26e-b354c8b9554b): created successfully
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6a6d13-d295-4c2a-b89a-7792690a0608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Flow 'volume_create_manager' (70b98642-e27a-4528-84b0-06357eff4a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc66a1-c1f8-496f-b0ac-7ef1f2002514]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aa819731-7f0c-42f3-b494-f93077ce52cc tempest-VolumesMetadataTest-2075608555 None] Created volume successfully.
Jun 01 01:48:30 devstack sudo[94520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:30 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:31 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:31 devstack sudo[94526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 1G
Jun 01 01:48:31 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:32 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 1G" returned: 0 in 0.911s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:32 devstack sudo[94532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43
Jun 01 01:48:32 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Acquiring lock "cinder-402a828c-ba72-4522-a26e-b354c8b9554b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Lock "cinder-402a828c-ba72-4522-a26e-b354c8b9554b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Acquiring lock "cinder-quobyte-402a828c-ba72-4522-a26e-b354c8b9554b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Lock "cinder-quobyte-402a828c-ba72-4522-a26e-b354c8b9554b" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95ef14-e99e-4a79-93f0-71ccced1785e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:32 devstack sudo[94534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b
Jun 01 01:48:32 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:33 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:33 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 is being set with open permissions: ugo+rw
Jun 01 01:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:33 devstack sudo[94539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43
Jun 01 01:48:33 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:33 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:33 devstack sudo[94545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b
Jun 01 01:48:33 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:33 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43" returned: 0 in 0.607s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.205s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2c344152-5720-4a60-9af8-88da6410796b tempest-SnapshotsActionsTest-1356900830 None] Create snapshot completed successfully
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:34 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Flow 'volume_create_manager' (c4faf7b9-3955-499d-92fc-99a13c685f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3ac90c-46e6-4b8f-8e38-2ac22491699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-402a828c-ba72-4522-a26e-b354c8b9554b" returned: 0 in 0.689s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3ac90c-46e6-4b8f-8e38-2ac22491699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-372365394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4aedfa-0869-4567-a85d-e9b190f6900f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b524e51deb774357805ebe03fe51e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:34Z,use_quota=True,user_id='1f993e85b9934001993bfb4bd541f382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c06a93-eb22-4ebf-9962-6a02e8276a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c06a93-eb22-4ebf-9962-6a02e8276a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff13e7a-f702-4207-acbe-2471d0368762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff13e7a-f702-4207-acbe-2471d0368762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4aedfa-0869-4567-a85d-e9b190f6900f', 'volume_name': 'volume-be4aedfa-0869-4567-a85d-e9b190f6900f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ff6d3-2312-43d4-a846-68e5650c420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ff6d3-2312-43d4-a846-68e5650c420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2902af-0c7a-4dec-aaa1-1a07bf82ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Volume be4aedfa-0869-4567-a85d-e9b190f6900f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4aedfa-0869-4567-a85d-e9b190f6900f', 'volume_size': 1}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-372365394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4aedfa-0869-4567-a85d-e9b190f6900f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b524e51deb774357805ebe03fe51e074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:34Z,use_quota=True,user_id='1f993e85b9934001993bfb4bd541f382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Creating volume be4aedfa-0869-4567-a85d-e9b190f6900f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Lock "cinder-quobyte-402a828c-ba72-4522-a26e-b354c8b9554b" released by "delete_volume" :: held 1.512s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:34 devstack sudo[94551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f 1073741824
Jun 01 01:48:34 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Created reservations ['1ef7fea7-5809-431c-969d-1c20c09b0527', 'c980f83e-c78d-43f1-99af-870b4d675b06', '0868da50-39b5-4176-ab66-ec5b73eeea98', '8fc7afa6-a0a5-47d0-8210-fcfbaa91c96c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:34 devstack sudo[94553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:34 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-13c09f0b-1e91-4de6-9be7-b4ecc5effe43-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-13c09f0b-1e91-4de6-9be7-b4ecc5effe43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-13c09f0b-1e91-4de6-9be7-b4ecc5effe43" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-13c09f0b-1e91-4de6-9be7-b4ecc5effe43" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Deleting offline snapshot 13c09f0b-1e91-4de6-9be7-b4ecc5effe43 of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] snapshot_file for this snap is: volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d0f760-764f-4e5e-96a7-339799f2e2f6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:34 devstack sudo[94555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43
Jun 01 01:48:34 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:35 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.675s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Deleted volume successfully.
Jun 01 01:48:35 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f 1073741824" returned: 0 in 0.879s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eb8889fa-fe2e-496c-bb7e-a7e2ec90362e tempest-VolumesMetadataTest-2075608555 None] Lock "cinder-402a828c-ba72-4522-a26e-b354c8b9554b-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:35 devstack sudo[94562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f
Jun 01 01:48:35 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:35 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43" returned: 0 in 0.952s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f37466-d622-442a-afdf-492a2881e2fe]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:35 devstack sudo[94567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:35 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:35 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2902af-0c7a-4dec-aaa1-1a07bf82ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4aedfa-0869-4567-a85d-e9b190f6900f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72285d2d-b54c-4565-8152-ed2505b74b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Volume volume-be4aedfa-0869-4567-a85d-e9b190f6900f (be4aedfa-0869-4567-a85d-e9b190f6900f): created successfully
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72285d2d-b54c-4565-8152-ed2505b74b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Flow 'volume_create_manager' (c4faf7b9-3955-499d-92fc-99a13c685f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "cinder-0e1d2378-dd45-42c8-9d20-62a48860096d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6a709f6f-cc91-4aad-8c61-d15bbaccfc7c tempest-AttachVolumeShelveTestJSON-208892794 None] Created volume successfully.
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-0e1d2378-dd45-42c8-9d20-62a48860096d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "cinder-quobyte-0e1d2378-dd45-42c8-9d20-62a48860096d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-quobyte-0e1d2378-dd45-42c8-9d20-62a48860096d" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[58102a63-1a26-4c2f-b752-6a451e6438ad]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:36 devstack sudo[94570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d
Jun 01 01:48:36 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:36 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.917s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:36 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43
Jun 01 01:48:36 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:37 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d" returned: 0 in 0.916s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:37 devstack sudo[94587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d
Jun 01 01:48:37 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:37 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:37 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43
Jun 01 01:48:37 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:37 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e1d2378-dd45-42c8-9d20-62a48860096d" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-quobyte-0e1d2378-dd45-42c8-9d20-62a48860096d" released by "delete_volume" :: held 1.746s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:37 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Created reservations ['10a45485-f38d-4437-b226-87dd6a56742a', 'dc2aa296-572b-4d5c-b8fa-09d60ab6368a', '050b9049-f423-41a5-be19-47845be4368b', '03ec8312-9005-4a55-97b8-ffd65bfaef97'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:38 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.13c09f0b-1e91-4de6-9be7-b4ecc5effe43" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:38 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:38 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-13c09f0b-1e91-4de6-9be7-b4ecc5effe43" released by "_delete_snapshot" :: held 3.526s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" released by "delete_snapshot" :: held 3.572s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Created reservations ['db194352-7d95-4c3a-aa39-758f4b162ed6', '947b1885-62b9-49e9-8137-30f5c495d5c7', '892ba552-9e31-4679-bee1-655e3f459824', 'e664acb2-16af-4395-912c-2cbbc377b366'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Delete snapshot completed successfully.
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ddc52c2a-7741-4b74-baa5-f622fe36ef18 tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-13c09f0b-1e91-4de6-9be7-b4ecc5effe43-delete_snapshot" released by "delete_snapshot" :: held 3.749s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "cinder-cff8c80b-c673-4b77-8388-a1311ad823b7-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-cff8c80b-c673-4b77-8388-a1311ad823b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Flow 'volume_create_manager' (4abaf535-d16b-4154-801a-549ae4412d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add08d84-8a0b-4f28-9b28-9f174b7b3d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add08d84-8a0b-4f28-9b28-9f174b7b3d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1933638745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985f4de5-7775-4213-965d-5055b581ed54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27f6063c4704bbca9b48c6209a47598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:38Z,use_quota=True,user_id='e5d808475ad54e56b43b525529987f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b589b48d-aa0b-40fa-bf4a-fb3f507c37b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b589b48d-aa0b-40fa-bf4a-fb3f507c37b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcc38a-7f92-4cb2-afb9-10f5553611c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcc38a-7f92-4cb2-afb9-10f5553611c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985f4de5-7775-4213-965d-5055b581ed54', 'volume_name': 'volume-985f4de5-7775-4213-965d-5055b581ed54', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31454013-6b3b-4e61-a7f0-fd18f3643b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31454013-6b3b-4e61-a7f0-fd18f3643b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb3cd68-faac-474e-b3bc-dbf7104ea7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Volume 985f4de5-7775-4213-965d-5055b581ed54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985f4de5-7775-4213-965d-5055b581ed54', 'volume_size': 2}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1933638745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985f4de5-7775-4213-965d-5055b581ed54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27f6063c4704bbca9b48c6209a47598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:38Z,use_quota=True,user_id='e5d808475ad54e56b43b525529987f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Creating volume 985f4de5-7775-4213-965d-5055b581ed54 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54 2147483648 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:38 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54 2147483648
Jun 01 01:48:38 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "cinder-quobyte-cff8c80b-c673-4b77-8388-a1311ad823b7" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-quobyte-cff8c80b-c673-4b77-8388-a1311ad823b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c8667a-840f-472b-b7dd-bcba6a318aa5]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:38 devstack sudo[94599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7
Jun 01 01:48:38 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:38 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Deleted volume successfully.
Jun 01 01:48:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07d32a28-e208-40a3-bfcd-813006b68020 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-0e1d2378-dd45-42c8-9d20-62a48860096d-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:39 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7" returned: 0 in 0.941s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:39 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7
Jun 01 01:48:39 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:39 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54 2147483648" returned: 0 in 1.133s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:39 devstack sudo[94651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54
Jun 01 01:48:39 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:40 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cff8c80b-c673-4b77-8388-a1311ad823b7" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-quobyte-cff8c80b-c673-4b77-8388-a1311ad823b7" released by "delete_volume" :: held 1.671s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Created reservations ['ac2941c5-25de-4536-bdb2-8d915788d2cc', 'd82e735f-2356-4643-9685-189480029cd6', 'f7300205-a7bc-4200-ac2b-bfaf53595f77', '395b0ca1-fb02-4ff1-95cb-04eac80e5471'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:40 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.204s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb3cd68-faac-474e-b3bc-dbf7104ea7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985f4de5-7775-4213-965d-5055b581ed54', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:40 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2c9857-f4b1-432f-a918-a241219ae1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:40 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Creating offline snapshot 80e17228-3b1f-4cb8-a63f-566364c0f9b4 of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:48:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Volume volume-985f4de5-7775-4213-965d-5055b581ed54 (985f4de5-7775-4213-965d-5055b581ed54): created successfully
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2c9857-f4b1-432f-a918-a241219ae1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Flow 'volume_create_manager' (4abaf535-d16b-4154-801a-549ae4412d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc390d-59c3-485d-a588-7f40d701ea21]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b389caa1-5f27-441a-8949-c72f37fab0d1 tempest-VolumesCloneNegativeTest-1485069423 None] Created volume successfully.
Jun 01 01:48:40 devstack sudo[94661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:40 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "cinder-14218811-7a1c-4e93-9bf3-42322e494f42-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Acquiring lock "cinder-985f4de5-7775-4213-965d-5055b581ed54-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-14218811-7a1c-4e93-9bf3-42322e494f42-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "cinder-985f4de5-7775-4213-965d-5055b581ed54-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "cinder-quobyte-14218811-7a1c-4e93-9bf3-42322e494f42" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Acquiring lock "cinder-quobyte-985f4de5-7775-4213-965d-5055b581ed54" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-quobyte-14218811-7a1c-4e93-9bf3-42322e494f42" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "cinder-quobyte-985f4de5-7775-4213-965d-5055b581ed54" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3cc6a2-c698-43fc-be8b-8952f4ba1696]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb081ba-1e76-425c-8d31-4b49dce2b700]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:41 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Deleted volume successfully.
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a9978d4-0ee0-4f50-a68f-5fd93eb40d52 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-cff8c80b-c673-4b77-8388-a1311ad823b7-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:41 devstack sudo[94664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42
Jun 01 01:48:41 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:41 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54
Jun 01 01:48:41 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:41 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:41 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 1G
Jun 01 01:48:41 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:41 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42" returned: 0 in 0.819s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:41 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42
Jun 01 01:48:41 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:41 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54" returned: 0 in 0.844s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:41 devstack sudo[94691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54
Jun 01 01:48:41 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:42 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 1G" returned: 0 in 0.931s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:42 devstack sudo[94696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4
Jun 01 01:48:42 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:42 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-14218811-7a1c-4e93-9bf3-42322e494f42" returned: 0 in 0.690s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-quobyte-14218811-7a1c-4e93-9bf3-42322e494f42" released by "delete_volume" :: held 1.578s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Created reservations ['521d98d7-ad52-4d2a-a706-c13bbded7c5f', '78925329-ab60-4cdd-874c-44003cbcbf03', '4c9a12c3-24db-4091-81b0-7c751c8236c4', '0947accb-24f6-4222-9d97-96db324520e3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:42 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-985f4de5-7775-4213-965d-5055b581ed54" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "cinder-quobyte-985f4de5-7775-4213-965d-5055b581ed54" released by "delete_volume" :: held 1.648s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:42 devstack sudo[94700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:42 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Created reservations ['850ca3d1-e11c-4f0d-ac3d-eb21ac948bd9', '523e8d8f-8763-46a4-a044-b65713e7698b', '5fa4d4a1-7a4c-4cfa-a936-ce37e3dc9ddb', 'a83892cb-b1e2-4024-b12c-c7380a7e0780'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:42 devstack sudo[94705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:42 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:42 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:42 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 is being set with open permissions: ugo+rw
Jun 01 01:48:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:43 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4
Jun 01 01:48:43 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:43 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.981s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:43 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Deleted volume successfully.
Jun 01 01:48:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-abf429c4-bd28-42c1-ab30-d3e9d7e58d76 tempest-AttachVolumeTestJSON-1803960860 None] Lock "cinder-14218811-7a1c-4e93-9bf3-42322e494f42-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:43 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.994s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:43 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Deleted volume successfully.
Jun 01 01:48:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fecebe1-978c-4444-9268-a43ee7b15e26 tempest-VolumesCloneNegativeTest-1485069423 None] Lock "cinder-985f4de5-7775-4213-965d-5055b581ed54-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:44 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4" returned: 0 in 1.044s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.728s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d675b3f7-6be7-4c7a-a542-8b0e1c918e9b tempest-SnapshotsActionsTest-1356900830 None] Create snapshot completed successfully
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-80e17228-3b1f-4cb8-a63f-566364c0f9b4-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-80e17228-3b1f-4cb8-a63f-566364c0f9b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-80e17228-3b1f-4cb8-a63f-566364c0f9b4" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-80e17228-3b1f-4cb8-a63f-566364c0f9b4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Deleting offline snapshot 80e17228-3b1f-4cb8-a63f-566364c0f9b4 of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] snapshot_file for this snap is: volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f5f6da-f956-447a-8d62-ac97a44e2682]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:44 devstack sudo[94714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4
Jun 01 01:48:44 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:45 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4" returned: 0 in 1.190s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba9c67-d100-48ed-be25-fb03df1fc93d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:46 devstack sudo[94755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:46 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:46 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:46 devstack sudo[94762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4
Jun 01 01:48:46 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:47 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4" returned: 0 in 0.884s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:47 devstack sudo[94768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4
Jun 01 01:48:47 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Flow 'volume_create_manager' (fd657c9e-28ad-4fd6-aed1-cb1137dcdb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83b79ac-447e-4f38-b704-312a59204d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83b79ac-447e-4f38-b704-312a59204d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-10081685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5d96b4-e5e8-4456-9f5e-403f67f831cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b3b22084ed48e6b3b6aa1a843b918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:48Z,use_quota=True,user_id='e95971dbd1e44503814a1efb50270d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d576d5e-0e32-48f8-898d-c06c4a430b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d576d5e-0e32-48f8-898d-c06c4a430b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb1b0b6-5cd3-46ba-ade5-7fe819778e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 01:48:48 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.80e17228-3b1f-4cb8-a63f-566364c0f9b4" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-80e17228-3b1f-4cb8-a63f-566364c0f9b4" released by "_delete_snapshot" :: held 3.858s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" released by "delete_snapshot" :: held 3.896s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Created reservations ['cc8857bf-6673-4c3a-a389-2fc62514a52f', '83ea724c-4986-4bd0-9de1-71ec217bd3cb', 'b996b345-1a22-454f-9108-456a53726de9', 'a38d699d-5b4e-4558-b6d4-43ffb5efe3c5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Delete snapshot completed successfully.
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb1b0b6-5cd3-46ba-ade5-7fe819778e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf5d96b4-e5e8-4456-9f5e-403f67f831cb', 'volume_name': 'volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72865566c620>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7415a7d0-9752-4c77-8ea8-c0b015cb5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7415a7d0-9752-4c77-8ea8-c0b015cb5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8df65f-e0db-4b25-8bd3-48ce093f9f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Volume cf5d96b4-e5e8-4456-9f5e-403f67f831cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72865566c620>}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Trying to clone cf5d96b4-e5e8-4456-9f5e-403f67f831cb from image e56da659-fc04-4789-a705-f5b7a7a6ddfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 01:48:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-29a0696b-c4c7-4019-adba-0303d22f47fb tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-80e17228-3b1f-4cb8-a63f-566364c0f9b4-delete_snapshot" released by "delete_snapshot" :: held 4.157s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 01:48:49 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Image download 20.69 MB at 20.69 MB/s
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29e60ba-432d-4fa7-b8de-1fad0334417e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Creating offline snapshot d5623bce-6590-484b-b585-e88bd4bb9dcd of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:48:49 devstack sudo[94793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD
Jun 01 01:48:49 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ddc908-7a68-49e6-ab9f-bb79409695bf]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:49 devstack sudo[94795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:49 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:50 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd is fetched for user e95971dbd1e44503814a1efb50270d8b. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c84438e-e710-4615-bf7d-9ed1d6f0b6ae]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:50 devstack sudo[94802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD
Jun 01 01:48:50 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:50 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.992s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:50 devstack sudo[94807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd 1G
Jun 01 01:48:50 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:50 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:51 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd 1G" returned: 0 in 1.026s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:51 devstack sudo[94817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd
Jun 01 01:48:51 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:52 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd" returned: 0 in 0.699s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:52 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd is being set with open permissions: ugo+rw
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:52 devstack sudo[94822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd
Jun 01 01:48:52 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:52 devstack sudo[94824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:48:52 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Flow 'volume_create_manager' (6418f6aa-0602-4a85-9acd-7b2c4d18c55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92eb8c3a-b50b-4183-b97d-2948746b9850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92eb8c3a-b50b-4183-b97d-2948746b9850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1250849804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e30649-8071-4c2f-86aa-a34b4c4bda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea6ab06dc934db2ae3a24a49f1d4d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:52Z,use_quota=True,user_id='99389507cc694e0287818da9126fd945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e71bfa-4904-4d6f-aec1-a5f0265f268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e71bfa-4904-4d6f-aec1-a5f0265f268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45581f3e-7347-4f3d-85e3-3271c2f80ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45581f3e-7347-4f3d-85e3-3271c2f80ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e30649-8071-4c2f-86aa-a34b4c4bda2e', 'volume_name': 'volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75be3c9a-4edc-4a0f-a9b8-c6f275b9043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75be3c9a-4edc-4a0f-a9b8-c6f275b9043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d565e8-41a5-468e-8d99-dbd3d4e01612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Volume 59e30649-8071-4c2f-86aa-a34b4c4bda2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e', 'volume_size': 1}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:52 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd" returned: 0 in 0.654s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.503s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.885s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-10081685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5d96b4-e5e8-4456-9f5e-403f67f831cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b3b22084ed48e6b3b6aa1a843b918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:48Z,use_quota=True,user_id='e95971dbd1e44503814a1efb50270d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Creating volume cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:52 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:52 devstack sudo[94827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 1073741824
Jun 01 01:48:52 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ec60eeeb-56ec-4294-8e62-7faac275df30 tempest-SnapshotsActionsTest-1356900830 None] Create snapshot completed successfully
Jun 01 01:48:53 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-97a6d667-c332-4ad5-820a-a4d40c450628 req-d28ed298-44d8-40d5-9b4c-c82e19d4630e tempest-AttachVolumeShelveTestJSON-208892794 None] No connector for attachment b4e95bfb-ef1f-41ac-aa40-dfe1ec3492b5; skipping storage backend terminate_connection call. {{(pid=86676) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-97a6d667-c332-4ad5-820a-a4d40c450628 req-d28ed298-44d8-40d5-9b4c-c82e19d4630e tempest-AttachVolumeShelveTestJSON-208892794 None] Deleting attachment b4e95bfb-ef1f-41ac-aa40-dfe1ec3492b5. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-d5623bce-6590-484b-b585-e88bd4bb9dcd-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-d5623bce-6590-484b-b585-e88bd4bb9dcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Acquiring lock "cinder-quobyte-d5623bce-6590-484b-b585-e88bd4bb9dcd" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:53 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 1073741824" returned: 0 in 0.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-d5623bce-6590-484b-b585-e88bd4bb9dcd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Deleting offline snapshot d5623bce-6590-484b-b585-e88bd4bb9dcd of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] snapshot_file for this snap is: volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4ec7f5-1560-4016-8a27-60ae0fd8ac02]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:53 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:48:53 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:53 devstack sudo[94842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd
Jun 01 01:48:53 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:54 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 0 in 0.655s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.938s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1250849804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e30649-8071-4c2f-86aa-a34b4c4bda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea6ab06dc934db2ae3a24a49f1d4d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:48:52Z,use_quota=True,user_id='99389507cc694e0287818da9126fd945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Creating volume 59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:48:54 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:54 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e 1073741824
Jun 01 01:48:54 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Attempting download of e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume cf5d96b4-e5e8-4456-9f5e-403f67f831cb. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a7ba6c-5288-4fab-b73c-25293be6d9e4]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_19wugqja {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:54 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd" returned: 0 in 0.864s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bbcaf1-3c05-498c-8c45-756c59cae9a9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:54 devstack sudo[94851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_19wugqja
Jun 01 01:48:54 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:54 devstack sudo[94852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:54 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:55 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_19wugqja" returned: 0 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_19wugqja {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:55 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e 1073741824" returned: 0 in 0.974s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:55 devstack sudo[94867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e
Jun 01 01:48:55 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:55 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:55 devstack sudo[94866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_19wugqja
Jun 01 01:48:55 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.808s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:55 devstack sudo[94870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd
Jun 01 01:48:55 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:56 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d565e8-41a5-468e-8d99-dbd3d4e01612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:56 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8058d458-47c7-4d73-9fbb-83e4a25fa248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_19wugqja" returned: 1 in 0.797s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_19wugqja' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[70802aa3-6e7f-4286-b675-8524f100cdbd]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:56 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Volume volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e (59e30649-8071-4c2f-86aa-a34b4c4bda2e): created successfully
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8058d458-47c7-4d73-9fbb-83e4a25fa248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Flow 'volume_create_manager' (6418f6aa-0602-4a85-9acd-7b2c4d18c55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:48:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-024a8d9e-b9fc-421c-9a30-77a7de32c26a req-74ecb904-6ad4-4574-be53-772875ae9333 tempest-VolumesSnapshotsTestJSON-1732254473 None] Created volume successfully.
Jun 01 01:48:56 devstack sudo[94880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD
Jun 01 01:48:56 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:56 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd" returned: 0 in 0.865s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:56 devstack sudo[94883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd
Jun 01 01:48:56 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:56 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] e56da659-fc04-4789-a705-f5b7a7a6ddfd was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 01:48:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:56 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:48:56 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:57 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.d5623bce-6590-484b-b585-e88bd4bb9dcd" returned: 0 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-d5623bce-6590-484b-b585-e88bd4bb9dcd" released by "_delete_snapshot" :: held 3.316s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" released by "delete_snapshot" :: held 3.350s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Creating offline snapshot 3dc99fef-5846-42ba-8d49-846f962aebaa of volume 59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Created reservations ['49b57c5b-556a-4e57-abbb-5ec023d147af', '676ac025-cebd-4b18-b12b-3668fc272cb8', 'e8ea3f12-a392-41c6-abc3-f07bd36f2970', '4b607330-5abb-44f3-a344-799c6a209f65'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752c791-ee8b-40d0-b336-a28d83bc12e3]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Delete snapshot completed successfully.
Jun 01 01:48:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0101152b-930f-4538-812e-614f1c5e7a8a tempest-SnapshotsActionsTest-1120769737 None] Lock "cinder-d5623bce-6590-484b-b585-e88bd4bb9dcd-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:48:57 devstack sudo[94892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e
Jun 01 01:48:57 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:58 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e" returned: 0 in 0.862s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:58 devstack sudo[94908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa 1G
Jun 01 01:48:58 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "cinder-02e08ff8-d877-4e34-9d8e-a67906e97e3f-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-02e08ff8-d877-4e34-9d8e-a67906e97e3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "cinder-quobyte-02e08ff8-d877-4e34-9d8e-a67906e97e3f" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-quobyte-02e08ff8-d877-4e34-9d8e-a67906e97e3f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Deleting offline snapshot 02e08ff8-d877-4e34-9d8e-a67906e97e3f of volume c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] snapshot_file for this snap is: volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb25931-1efa-470a-a08a-5f450bdeae26]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:58 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:48:58 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:59 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 0 in 2.127s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_apr9w9ppdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:48:59 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Converted 112.00 MB image at 52.62 MB/s
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:59 devstack sudo[94917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 1G
Jun 01 01:48:59 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:59 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa 1G" returned: 0 in 0.988s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:59 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa
Jun 01 01:48:59 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:59 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.722s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c840f59f-cbb4-446b-8f66-d95108f5f445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec3e044-ac26-47b5-8e64-40602b5b3c67]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:59 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445
Jun 01 01:48:59 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:59 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 1G" returned: 0 in 0.652s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[260f151a-0184-41be-8e83-2160410f43f2]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:59 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:48:59 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa is being set with open permissions: ugo+rw
Jun 01 01:48:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:48:59 devstack sudo[94932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:48:59 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:48:59 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa
Jun 01 01:48:59 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:00 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445" returned: 0 in 0.829s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:00 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:49:00 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:00 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa" returned: 0 in 0.621s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:00 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:00 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.info
Jun 01 01:49:00 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:00 devstack sudo[94947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:49:00 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:00 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.721s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:00 devstack sudo[94953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f
Jun 01 01:49:00 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:01 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.info" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:01 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.info is being set with open permissions: ugo+rw
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:01 devstack sudo[94956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.info
Jun 01 01:49:01 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:01 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 1 in 0.927s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Downloaded image e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume cf5d96b4-e5e8-4456-9f5e-403f67f831cb successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd for user e95971dbd1e44503814a1efb50270d8b is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Marking volume cf5d96b4-e5e8-4456-9f5e-403f67f831cb as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Copying metadata from image e56da659-fc04-4789-a705-f5b7a7a6ddfd to cf5d96b4-e5e8-4456-9f5e-403f67f831cb. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Creating volume glance metadata for volume cf5d96b4-e5e8-4456-9f5e-403f67f831cb backed by image e56da659-fc04-4789-a705-f5b7a7a6ddfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 01:49:01 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445.02e08ff8-d877-4e34-9d8e-a67906e97e3f" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8df65f-e0db-4b25-8bd3-48ce093f9f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72865566c620>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0f6a52-6d4f-4fcd-adaa-af74a4dc35fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-quobyte-02e08ff8-d877-4e34-9d8e-a67906e97e3f" released by "_delete_snapshot" :: held 3.188s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Volume volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb (cf5d96b4-e5e8-4456-9f5e-403f67f831cb): created successfully
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0f6a52-6d4f-4fcd-adaa-af74a4dc35fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Flow 'volume_create_manager' (fd657c9e-28ad-4fd6-aed1-cb1137dcdb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" released by "delete_snapshot" :: held 3.240s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c4f636b8-6437-4af1-8120-e7f46171afd2 tempest-VolumesExtendTest-160264342 None] Created volume successfully.
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Created reservations ['aaf82947-8677-48c7-894e-00b97ce96546', 'eb28e460-abd6-422e-85cc-3936d82f6d4b', '866469b3-6f36-4dba-b5c2-52fcb560e0c7', '528f1b48-4923-4a44-8d89-8691f7243bed'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Delete snapshot completed successfully.
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d918ce2f-e713-44b7-a73a-15a9e0b54918 tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-02e08ff8-d877-4e34-9d8e-a67906e97e3f-delete_snapshot" released by "delete_snapshot" :: held 3.399s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:01 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.info" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.772s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-c9adbcdc-837a-46ed-83a2-5b6dcfc7bccf req-885a57fd-314d-4642-824f-dbc554cd839f tempest-VolumesSnapshotsTestJSON-1732254473 None] Create snapshot completed successfully
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b17509-4a84-43b2-8341-e618aa0a24eb]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:02 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:49:02 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "cinder-c840f59f-cbb4-446b-8f66-d95108f5f445-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-c840f59f-cbb4-446b-8f66-d95108f5f445-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "cinder-3dc99fef-5846-42ba-8d49-846f962aebaa-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[646df36f-9b2f-4ea5-9657-ccc0ed4e4ff5]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-3dc99fef-5846-42ba-8d49-846f962aebaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "cinder-quobyte-59e30649-8071-4c2f-86aa-a34b4c4bda2e" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-quobyte-59e30649-8071-4c2f-86aa-a34b4c4bda2e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "cinder-quobyte-3dc99fef-5846-42ba-8d49-846f962aebaa" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-quobyte-3dc99fef-5846-42ba-8d49-846f962aebaa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Deleting offline snapshot 3dc99fef-5846-42ba-8d49-846f962aebaa of volume 59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:49:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] snapshot_file for this snap is: volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2236b4-3131-4988-8a21-c91b53615f2e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:03 devstack sudo[94967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445
Jun 01 01:49:03 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:03 devstack sudo[94968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa
Jun 01 01:49:03 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:03 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:03 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:49:03 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:03 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:03 devstack sudo[94981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445
Jun 01 01:49:03 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:03 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa" returned: 0 in 0.743s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4fc46c-4855-4882-812e-b8f2d20fcb21]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:03 devstack sudo[94983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e
Jun 01 01:49:03 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:04 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 1 in 0.983s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 2G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb 2G" returned: 0 in 0.077s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.878s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-40cdc61e-5316-412c-b0a7-007f514b8c42 tempest-VolumesExtendTest-160264342 None] Extend volume completed successfully.
Jun 01 01:49:04 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c840f59f-cbb4-446b-8f66-d95108f5f445" returned: 0 in 0.931s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-quobyte-c840f59f-cbb4-446b-8f66-d95108f5f445" released by "delete_volume" :: held 1.762s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Created reservations ['20238211-9046-4fa8-8e6e-9909eeb6a039', '5a27ae47-c420-4556-a4fd-0955e5de4680', '6f0f13f5-1a15-4267-aab5-ad93f7e8fa76', '8da83c33-0357-43ca-aeb6-6b83f3235c49'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:04 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e" returned: 0 in 0.981s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:04 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa
Jun 01 01:49:04 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:04 devstack sudo[94997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:04 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Acquiring lock "cinder-cf5d96b4-e5e8-4456-9f5e-403f67f831cb-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Lock "cinder-cf5d96b4-e5e8-4456-9f5e-403f67f831cb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Acquiring lock "cinder-quobyte-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d074b7e-92e5-4073-bf1c-71bc2052ed2e]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:05 devstack sudo[94999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:49:05 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:05 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.023s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Deleted volume successfully.
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-92c72166-232e-450c-9bf2-7366c6e9e8cf tempest-SnapshotsActionsTest-1356900830 None] Lock "cinder-c840f59f-cbb4-446b-8f66-d95108f5f445-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:05 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa" returned: 0 in 1.210s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:06 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 0 in 0.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:06 devstack sudo[95019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa
Jun 01 01:49:06 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:06 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:49:06 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:06 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e.3dc99fef-5846-42ba-8d49-846f962aebaa" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-quobyte-3dc99fef-5846-42ba-8d49-846f962aebaa" released by "_delete_snapshot" :: held 3.855s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-quobyte-59e30649-8071-4c2f-86aa-a34b4c4bda2e" released by "delete_snapshot" :: held 3.895s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:06 devstack cinder-volume[86676]: DEBUG cinder.quota [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Created reservations ['74ca989f-8240-4cf4-9a2a-6f898b495719', '8f70fc89-39ef-4968-931c-17001b902d4f', '97e874dd-c9f2-47ba-a530-76e36e042363', '21dd6f5d-71fa-4982-be93-0bd09f2ed86d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:07 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 1 in 1.010s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Delete snapshot completed successfully.
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-d4ff9fb7-fd0f-42d5-8cd6-5933e6ff49af req-fc8eb91e-fa05-4081-b2ea-8fb029a26269 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-3dc99fef-5846-42ba-8d49-846f962aebaa-delete_snapshot" released by "delete_snapshot" :: held 4.123s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:07 devstack sudo[95043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb
Jun 01 01:49:07 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "cinder-59e30649-8071-4c2f-86aa-a34b4c4bda2e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-59e30649-8071-4c2f-86aa-a34b4c4bda2e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "cinder-quobyte-59e30649-8071-4c2f-86aa-a34b4c4bda2e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-quobyte-59e30649-8071-4c2f-86aa-a34b4c4bda2e" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f82c4-d170-4f8a-ba62-bb98ade869b9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:07 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" returned: 0 in 0.694s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:07 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e
Jun 01 01:49:07 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-cf5d96b4-e5e8-4456-9f5e-403f67f831cb" released by "delete_volume" :: held 2.721s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Created reservations ['cb8b18b1-cb82-49ed-81b3-16f4a4770f16', '942d64d7-35b4-459c-8c95-49f2aa250434', '20f15030-6b55-4c60-9c3b-0c273796419e', 'e4d7d709-e33c-40a8-8147-8df84e26f953'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:07 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:07 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:08 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e" returned: 0 in 1.145s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:08 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e
Jun 01 01:49:08 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:08 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.005s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:08 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Deleted volume successfully.
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Flow 'volume_create_manager' (d973b280-f64f-4f1e-b468-d72fe220f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7024a505-aab1-45fe-ba8c-a563706f5bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7024a505-aab1-45fe-ba8c-a563706f5bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2027895817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261199ef-ad87-4db8-a212-d5e5e9d54a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b3b22084ed48e6b3b6aa1a843b918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:09Z,use_quota=True,user_id='e95971dbd1e44503814a1efb50270d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7404e8a5-6525-4a67-860f-8ff0ac99c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7404e8a5-6525-4a67-860f-8ff0ac99c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9feb7d-f77b-4255-b42c-5cbc29602aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9feb7d-f77b-4255-b42c-5cbc29602aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261199ef-ad87-4db8-a212-d5e5e9d54a8e', 'volume_name': 'volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b41a742-a0bb-40c3-9d22-5b19897a40e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b41a742-a0bb-40c3-9d22-5b19897a40e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a60e230-091e-45c8-bfd6-36876305df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Volume 261199ef-ad87-4db8-a212-d5e5e9d54a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e', 'volume_size': 1}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2027895817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261199ef-ad87-4db8-a212-d5e5e9d54a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b3b22084ed48e6b3b6aa1a843b918f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:09Z,use_quota=True,user_id='e95971dbd1e44503814a1efb50270d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Creating volume 261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:09 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ec509c28-9911-4c20-bcf8-cc674028d117 tempest-VolumesExtendTest-160264342 None] Lock "cinder-cf5d96b4-e5e8-4456-9f5e-403f67f831cb-delete_volume" released by "delete_volume" :: held 4.271s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:09 devstack sudo[95068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e 1073741824
Jun 01 01:49:09 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:09 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-59e30649-8071-4c2f-86aa-a34b4c4bda2e" returned: 0 in 0.869s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-quobyte-59e30649-8071-4c2f-86aa-a34b4c4bda2e" released by "delete_volume" :: held 2.101s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.quota [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Created reservations ['6dac68c3-3973-4ec0-8f1e-c81274055bd0', '7bd0bfe4-2b58-47ee-b1aa-fce816e27f87', 'ce60d982-faa6-454c-9621-67d6de1d3d43', '9b42367c-e510-48f3-9d6d-09ae447abf82'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:09 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:09 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:10 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e 1073741824" returned: 0 in 1.027s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:10 devstack sudo[95077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e
Jun 01 01:49:10 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:10 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.703s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG cinder.manager [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Deleted volume successfully.
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-22084ba4-c0f8-4fb7-b7c1-d7730f9733ec req-dd70059e-f583-494c-92ea-10a1d9ea98b8 tempest-VolumesSnapshotsTestJSON-1732254473 None] Lock "cinder-59e30649-8071-4c2f-86aa-a34b4c4bda2e-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:10 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e" returned: 0 in 0.660s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a60e230-091e-45c8-bfd6-36876305df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33600e9f-f2af-4666-a1fc-9167bedbc0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Volume volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e (261199ef-ad87-4db8-a212-d5e5e9d54a8e): created successfully
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33600e9f-f2af-4666-a1fc-9167bedbc0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Flow 'volume_create_manager' (d973b280-f64f-4f1e-b468-d72fe220f24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2a02d08a-eb6b-48ca-88f9-eba82aff1124 tempest-VolumesExtendTest-160264342 None] Created volume successfully.
Jun 01 01:49:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Creating offline snapshot 13ee44f8-7947-4a91-bff2-03cc04e939fb of volume 261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:49:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d8fa5b-033e-40e2-947a-da008b6ac739]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:11 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e
Jun 01 01:49:11 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:12 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e" returned: 0 in 0.939s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:12 devstack sudo[95101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb 1G
Jun 01 01:49:12 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Flow 'volume_create_manager' (9efc5ab5-afb1-4f34-9755-c2d5199b4664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937bd115-8599-44a1-8c8a-242224005d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937bd115-8599-44a1-8c8a-242224005d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-393612834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfa777c-428e-46c0-b5bc-fc0733161c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec4b87ad0941a9b368622f6ccf50fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:12Z,use_quota=True,user_id='0874cb59f0384416bda4f5d4420f13b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91aa2f1-f380-4856-a0e8-e2fb50eb5f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91aa2f1-f380-4856-a0e8-e2fb50eb5f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4524466f-3dcb-4397-8be6-7396a5ef7f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4524466f-3dcb-4397-8be6-7396a5ef7f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfa777c-428e-46c0-b5bc-fc0733161c36', 'volume_name': 'volume-7dfa777c-428e-46c0-b5bc-fc0733161c36', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6018ec-035a-42e7-b4e0-f63c7044ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6018ec-035a-42e7-b4e0-f63c7044ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b901cb61-bbdd-40ae-bc3a-12116bb15019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:12 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Volume 7dfa777c-428e-46c0-b5bc-fc0733161c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfa777c-428e-46c0-b5bc-fc0733161c36', 'volume_size': 1}
Jun 01 01:49:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:13 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb 1G" returned: 0 in 1.499s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:13 devstack sudo[95160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb
Jun 01 01:49:13 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:14 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:14 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb is being set with open permissions: ugo+rw
Jun 01 01:49:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:14 devstack sudo[95165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb
Jun 01 01:49:14 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=134,cinder:SELECT=121,cinder:INSERT=38,cinder:DELETE=8 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=143,cinder:DELETE=14,cinder:SELECT=122,cinder:INSERT=43 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Flow 'volume_create_manager' (d43ff8c9-8d65-4ad0-9d00-042443d5a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45be4d1c-bde0-4142-b02a-3e5af8f5734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45be4d1c-bde0-4142-b02a-3e5af8f5734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425095026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d7499d-598a-4ffb-b03f-08abd972f9f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c83ef65a3841cdbb8ddcd1502d5b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:15Z,use_quota=True,user_id='420d00cc6f714136a4ea3c801310583f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ed04db-b437-4b27-aae1-66f5c4bc1341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ed04db-b437-4b27-aae1-66f5c4bc1341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafcb1aa-2dd2-483c-92fd-25685327d27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafcb1aa-2dd2-483c-92fd-25685327d27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d7499d-598a-4ffb-b03f-08abd972f9f3', 'volume_name': 'volume-92d7499d-598a-4ffb-b03f-08abd972f9f3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1002df39-dc2d-4d7c-8679-7574fb00e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1002df39-dc2d-4d7c-8679-7574fb00e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3ea584-573c-4ca8-b9f7-963e54db99c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Volume 92d7499d-598a-4ffb-b03f-08abd972f9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d7499d-598a-4ffb-b03f-08abd972f9f3', 'volume_size': 1}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:15 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb" returned: 0 in 0.907s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:15 devstack sudo[95169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.info
Jun 01 01:49:15 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:16 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.info" returned: 0 in 0.645s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:16 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.info is being set with open permissions: ugo+rw
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:16 devstack sudo[95172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.info
Jun 01 01:49:16 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:16 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.info" returned: 0 in 0.578s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.479s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.151s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-393612834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfa777c-428e-46c0-b5bc-fc0733161c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec4b87ad0941a9b368622f6ccf50fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:12Z,use_quota=True,user_id='0874cb59f0384416bda4f5d4420f13b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Creating volume 7dfa777c-428e-46c0-b5bc-fc0733161c36 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:16 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:16 devstack sudo[95175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36 1073741824
Jun 01 01:49:16 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b3e80e64-db43-4d9e-ac21-99c8a38cfa01 tempest-VolumesExtendTest-160264342 None] Create snapshot completed successfully
Jun 01 01:49:17 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36 1073741824" returned: 0 in 0.766s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:17 devstack sudo[95181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36
Jun 01 01:49:17 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:18 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.920s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425095026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d7499d-598a-4ffb-b03f-08abd972f9f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c83ef65a3841cdbb8ddcd1502d5b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:15Z,use_quota=True,user_id='420d00cc6f714136a4ea3c801310583f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Creating volume 92d7499d-598a-4ffb-b03f-08abd972f9f3 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:18 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:18 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3 1073741824
Jun 01 01:49:18 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b901cb61-bbdd-40ae-bc3a-12116bb15019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfa777c-428e-46c0-b5bc-fc0733161c36', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2149e1ab-ea81-483d-9c7d-bf1753ce017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Volume volume-7dfa777c-428e-46c0-b5bc-fc0733161c36 (7dfa777c-428e-46c0-b5bc-fc0733161c36): created successfully
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2149e1ab-ea81-483d-9c7d-bf1753ce017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Flow 'volume_create_manager' (9efc5ab5-afb1-4f34-9755-c2d5199b4664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0233e8da-4ab5-471c-ac3b-d7c7e481050d tempest-VolumesServicesTestJSON-1779980728 None] Created volume successfully.
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Acquiring lock "cinder-7dfa777c-428e-46c0-b5bc-fc0733161c36-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Lock "cinder-7dfa777c-428e-46c0-b5bc-fc0733161c36-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:19 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3 1073741824" returned: 0 in 0.865s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Acquiring lock "cinder-quobyte-7dfa777c-428e-46c0-b5bc-fc0733161c36" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Lock "cinder-quobyte-7dfa777c-428e-46c0-b5bc-fc0733161c36" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[af375775-86ab-486b-a964-b5f734cb52ce]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:19 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3
Jun 01 01:49:19 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:19 devstack sudo[95190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36
Jun 01 01:49:19 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:19 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3" returned: 0 in 0.599s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a3d0f7-0329-449d-8dae-33c8d1dbf299]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3ea584-573c-4ca8-b9f7-963e54db99c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d7499d-598a-4ffb-b03f-08abd972f9f3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56b59f1-df0b-489a-bbe0-57440bd299f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Volume volume-92d7499d-598a-4ffb-b03f-08abd972f9f3 (92d7499d-598a-4ffb-b03f-08abd972f9f3): created successfully
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56b59f1-df0b-489a-bbe0-57440bd299f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Flow 'volume_create_manager' (d43ff8c9-8d65-4ad0-9d00-042443d5a347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ff58d0e8-b04b-4075-b7e1-f0955857a2c9 tempest-VolumesTestJSON-1238072481 None] Created volume successfully.
Jun 01 01:49:20 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36" returned: 0 in 0.743s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:20 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36
Jun 01 01:49:20 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:20 devstack sudo[95197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e
Jun 01 01:49:20 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:20 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7dfa777c-428e-46c0-b5bc-fc0733161c36" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Lock "cinder-quobyte-7dfa777c-428e-46c0-b5bc-fc0733161c36" released by "delete_volume" :: held 1.508s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:20 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e" returned: 0 in 0.870s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb 2G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:20 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Created reservations ['4e32b080-b297-428c-a792-3d9618666c52', '1efd9566-f61e-41ab-8877-a70adc060839', '12595872-0217-4737-a3b9-7764213aa22e', 'fba7bbf6-8168-49e0-bdc7-38bbfd565193'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb 2G" returned: 0 in 0.240s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.168s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:21 devstack sudo[95209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:21 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Flow 'volume_create_manager' (f0bb8d5f-76de-408e-bba0-fa6cdeeea745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b49ae93-14bd-4f35-b203-07073a4699d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b49ae93-14bd-4f35-b203-07073a4699d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1569011238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40895a7e-b1ed-4918-bf51-92552dac736a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c83ef65a3841cdbb8ddcd1502d5b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:21Z,use_quota=True,user_id='420d00cc6f714136a4ea3c801310583f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd51e10-911d-4398-8b1f-cbe933bd7ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd51e10-911d-4398-8b1f-cbe933bd7ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1a7987-3aa3-4694-85ec-c69e04b30c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1a7987-3aa3-4694-85ec-c69e04b30c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40895a7e-b1ed-4918-bf51-92552dac736a', 'volume_name': 'volume-40895a7e-b1ed-4918-bf51-92552dac736a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1aaa0a-c8d1-4c80-8dc0-da9d6d72f269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1aaa0a-c8d1-4c80-8dc0-da9d6d72f269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17eefe4-8caa-473a-b2bd-d94da3795f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:21 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Volume 40895a7e-b1ed-4918-bf51-92552dac736a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40895a7e-b1ed-4918-bf51-92552dac736a', 'volume_size': 1}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1569011238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40895a7e-b1ed-4918-bf51-92552dac736a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c83ef65a3841cdbb8ddcd1502d5b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:21Z,use_quota=True,user_id='420d00cc6f714136a4ea3c801310583f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Creating volume 40895a7e-b1ed-4918-bf51-92552dac736a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:21 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:21 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a 1073741824
Jun 01 01:49:21 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-191885a0-4184-4343-9ed6-8750c0b0c11f tempest-VolumesExtendTest-160264342 None] Extend volume completed successfully.
Jun 01 01:49:21 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.799s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Deleted volume successfully.
Jun 01 01:49:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7014213e-d497-458a-a04b-918b66460dd7 tempest-VolumesServicesTestJSON-1779980728 None] Lock "cinder-7dfa777c-428e-46c0-b5bc-fc0733161c36-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:22 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a 1073741824" returned: 0 in 0.875s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:22 devstack sudo[95218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a
Jun 01 01:49:22 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Acquiring lock "cinder-13ee44f8-7947-4a91-bff2-03cc04e939fb-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Lock "cinder-13ee44f8-7947-4a91-bff2-03cc04e939fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Acquiring lock "cinder-quobyte-261199ef-ad87-4db8-a212-d5e5e9d54a8e" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-261199ef-ad87-4db8-a212-d5e5e9d54a8e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Acquiring lock "cinder-quobyte-13ee44f8-7947-4a91-bff2-03cc04e939fb" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-13ee44f8-7947-4a91-bff2-03cc04e939fb" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Deleting offline snapshot 13ee44f8-7947-4a91-bff2-03cc04e939fb of volume 261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] snapshot_file for this snap is: volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b05dfd8-6cd7-4189-b8a2-5451ee2aef94]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:22 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb
Jun 01 01:49:22 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:22 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a" returned: 0 in 0.834s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17eefe4-8caa-473a-b2bd-d94da3795f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40895a7e-b1ed-4918-bf51-92552dac736a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3435a8-609d-4429-b616-202014d56022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:23 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Volume volume-40895a7e-b1ed-4918-bf51-92552dac736a (40895a7e-b1ed-4918-bf51-92552dac736a): created successfully
Jun 01 01:49:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3435a8-609d-4429-b616-202014d56022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Flow 'volume_create_manager' (f0bb8d5f-76de-408e-bba0-fa6cdeeea745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f1bbe992-54b5-4f52-a986-71f8027d8e82 tempest-VolumesTestJSON-1238072481 None] Created volume successfully.
Jun 01 01:49:23 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb" returned: 0 in 1.130s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:49:23 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[07830959-2a8e-4921-9058-9df29153266e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:23 devstack sudo[95233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e
Jun 01 01:49:23 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Flow 'volume_create_manager' (8a31e6d8-e380-4d20-933c-cd465f4cd536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a802887b-42c9-41e7-83ac-0406002b4840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a802887b-42c9-41e7-83ac-0406002b4840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2013121056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28486049-9140-43f6-a7f5-121c45ee52fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c83ef65a3841cdbb8ddcd1502d5b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:24Z,use_quota=True,user_id='420d00cc6f714136a4ea3c801310583f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23403561-2878-4afe-884e-741f3443566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23403561-2878-4afe-884e-741f3443566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7f7072-9da6-45ca-9f6b-c31a4309ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7f7072-9da6-45ca-9f6b-c31a4309ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28486049-9140-43f6-a7f5-121c45ee52fd', 'volume_name': 'volume-28486049-9140-43f6-a7f5-121c45ee52fd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62299db9-1358-4758-aeb1-c3f7c170ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62299db9-1358-4758-aeb1-c3f7c170ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1649d5-0f38-41e8-b514-ce7c37018a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Volume 28486049-9140-43f6-a7f5-121c45ee52fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28486049-9140-43f6-a7f5-121c45ee52fd', 'volume_size': 1}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2013121056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28486049-9140-43f6-a7f5-121c45ee52fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c83ef65a3841cdbb8ddcd1502d5b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:24Z,use_quota=True,user_id='420d00cc6f714136a4ea3c801310583f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Creating volume 28486049-9140-43f6-a7f5-121c45ee52fd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:24 devstack sudo[95238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd 1073741824
Jun 01 01:49:24 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:25 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e" returned: 0 in 1.329s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:25 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb
Jun 01 01:49:25 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:25 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd 1073741824" returned: 0 in 1.213s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:25 devstack sudo[95250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd
Jun 01 01:49:25 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:26 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb" returned: 0 in 0.932s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:26 devstack sudo[95256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb
Jun 01 01:49:26 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:26 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd" returned: 0 in 0.865s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1649d5-0f38-41e8-b514-ce7c37018a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28486049-9140-43f6-a7f5-121c45ee52fd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06919fb6-cd75-43c2-b482-e451ac1a5960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Volume volume-28486049-9140-43f6-a7f5-121c45ee52fd (28486049-9140-43f6-a7f5-121c45ee52fd): created successfully
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06919fb6-cd75-43c2-b482-e451ac1a5960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Flow 'volume_create_manager' (8a31e6d8-e380-4d20-933c-cd465f4cd536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-42cb07da-cab4-46eb-99f8-0d69f2ffc639 tempest-VolumesTestJSON-1238072481 None] Created volume successfully.
Jun 01 01:49:26 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e.13ee44f8-7947-4a91-bff2-03cc04e939fb" returned: 0 in 0.838s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-13ee44f8-7947-4a91-bff2-03cc04e939fb" released by "_delete_snapshot" :: held 4.369s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-261199ef-ad87-4db8-a212-d5e5e9d54a8e" released by "delete_snapshot" :: held 4.415s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:26 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Created reservations ['62969ebd-df2b-4512-8fe9-e6f4f3bbfad9', '116ac735-35ff-4438-905f-189735f47b98', '6d41fc7c-7852-4a6c-b773-8267b49e2221', '3d7627a4-06c0-49ce-94aa-af358075f3cd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Delete snapshot completed successfully.
Jun 01 01:49:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-561ce24d-ce90-4bd5-9410-d3ed3ace6193 tempest-VolumesExtendTest-160264342 None] Lock "cinder-13ee44f8-7947-4a91-bff2-03cc04e939fb-delete_snapshot" released by "delete_snapshot" :: held 4.579s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Acquiring lock "cinder-261199ef-ad87-4db8-a212-d5e5e9d54a8e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Lock "cinder-261199ef-ad87-4db8-a212-d5e5e9d54a8e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Acquiring lock "cinder-quobyte-261199ef-ad87-4db8-a212-d5e5e9d54a8e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-261199ef-ad87-4db8-a212-d5e5e9d54a8e" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a5d61-6894-44ae-ade3-77d94f3dc0eb]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:28 devstack sudo[95261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e
Jun 01 01:49:28 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "cinder-28486049-9140-43f6-a7f5-121c45ee52fd-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-28486049-9140-43f6-a7f5-121c45ee52fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "cinder-quobyte-28486049-9140-43f6-a7f5-121c45ee52fd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-quobyte-28486049-9140-43f6-a7f5-121c45ee52fd" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5366adcb-ab1b-4045-9e4e-b4477c5034cc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:28 devstack sudo[95263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd
Jun 01 01:49:28 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:28 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:28 devstack sudo[95269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e
Jun 01 01:49:28 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:29 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd" returned: 0 in 0.763s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:29 devstack sudo[95274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd
Jun 01 01:49:29 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:29 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-261199ef-ad87-4db8-a212-d5e5e9d54a8e" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Lock "cinder-quobyte-261199ef-ad87-4db8-a212-d5e5e9d54a8e" released by "delete_volume" :: held 1.529s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Created reservations ['fbf67be2-fabf-4acc-8977-f29074b13986', '66d92a96-fc2a-4185-bf17-7279f870521b', '08d36439-9cdb-430c-93a6-be08425cd2ba', '1b0c9881-369d-4119-b94d-39e0e9a23a1f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:29 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:29 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:29 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-28486049-9140-43f6-a7f5-121c45ee52fd" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-quobyte-28486049-9140-43f6-a7f5-121c45ee52fd" released by "delete_volume" :: held 1.506s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Created reservations ['d4c05307-72cc-44b7-bd09-c3d77d685ead', '71e6bc19-741e-428c-b12f-a8f6f15b9818', '8ae4aa23-e4fc-4301-ada7-8b5562f38557', '6f22651a-d8b4-4733-a88e-6d205fc4bbdf'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:30 devstack sudo[95280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:30 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:30 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.684s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Deleted volume successfully.
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-591c8e04-f5a2-452d-89b8-42af4efb82b6 tempest-VolumesExtendTest-160264342 None] Lock "cinder-261199ef-ad87-4db8-a212-d5e5e9d54a8e-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:30 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.738s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Deleted volume successfully.
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "cinder-40895a7e-b1ed-4918-bf51-92552dac736a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f6448791-6c25-4263-a96a-e623d7a86ca9 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-28486049-9140-43f6-a7f5-121c45ee52fd-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-40895a7e-b1ed-4918-bf51-92552dac736a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "cinder-quobyte-40895a7e-b1ed-4918-bf51-92552dac736a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-quobyte-40895a7e-b1ed-4918-bf51-92552dac736a" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:31 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd918b30-e0ee-47f8-9f5e-96590eb51282]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:31 devstack sudo[95285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a
Jun 01 01:49:31 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:31 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a" returned: 0 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:31 devstack sudo[95290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a
Jun 01 01:49:31 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:32 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40895a7e-b1ed-4918-bf51-92552dac736a" returned: 0 in 0.663s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-quobyte-40895a7e-b1ed-4918-bf51-92552dac736a" released by "delete_volume" :: held 1.518s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Created reservations ['5b7f239c-51cf-4bf0-8369-6b46810ab347', 'd246a411-3789-45cf-957c-d021c1b46773', 'bedd680d-8abe-4caa-9085-b509de9cc664', '6b7f9d70-dcec-4810-8a26-d803a94fba53'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:32 devstack sudo[95293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:32 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "cinder-92d7499d-598a-4ffb-b03f-08abd972f9f3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-92d7499d-598a-4ffb-b03f-08abd972f9f3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:33 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.743s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Deleted volume successfully.
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "cinder-quobyte-92d7499d-598a-4ffb-b03f-08abd972f9f3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-quobyte-92d7499d-598a-4ffb-b03f-08abd972f9f3" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-529e20c9-2b97-4d27-b8d2-63dd6bef0ba7 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-40895a7e-b1ed-4918-bf51-92552dac736a-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e542b7-8d34-4d41-9ee9-6327493c572d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:33 devstack sudo[95298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3
Jun 01 01:49:33 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Flow 'volume_create_manager' (131f265f-af0f-4b4c-aeec-b783760478c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69451444-4d4b-4826-bb11-2199975eed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69451444-4d4b-4826-bb11-2199975eed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1014020847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e163ddc-edc1-400c-b7df-016e1096b22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212345bf86d74a259afad162030f09ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:34Z,use_quota=True,user_id='3de8bd21534044b0985c88e2d38127e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a1967-e593-4e3d-8d7e-de85c99d730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a1967-e593-4e3d-8d7e-de85c99d730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c333e89-1a00-4382-a7dd-1ba0f5c93e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c333e89-1a00-4382-a7dd-1ba0f5c93e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e163ddc-edc1-400c-b7df-016e1096b22e', 'volume_name': 'volume-7e163ddc-edc1-400c-b7df-016e1096b22e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33435e0-518d-4b91-89dc-a80ad34eb324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33435e0-518d-4b91-89dc-a80ad34eb324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3b4f82-fb89-42b5-9743-7e6e621ee656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Volume 7e163ddc-edc1-400c-b7df-016e1096b22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e163ddc-edc1-400c-b7df-016e1096b22e', 'volume_size': 1}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1014020847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e163ddc-edc1-400c-b7df-016e1096b22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212345bf86d74a259afad162030f09ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:34Z,use_quota=True,user_id='3de8bd21534044b0985c88e2d38127e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Creating volume 7e163ddc-edc1-400c-b7df-016e1096b22e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:33 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:34 devstack sudo[95302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e 1073741824
Jun 01 01:49:34 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:34 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3" returned: 0 in 1.029s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:34 devstack sudo[95308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3
Jun 01 01:49:34 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:35 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e 1073741824" returned: 0 in 1.099s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:35 devstack sudo[95316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e
Jun 01 01:49:35 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:35 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92d7499d-598a-4ffb-b03f-08abd972f9f3" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-quobyte-92d7499d-598a-4ffb-b03f-08abd972f9f3" released by "delete_volume" :: held 1.882s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Created reservations ['d9867fb3-3d42-4e02-ac08-e903dfb4b5b2', 'd32fade0-f0ff-4b36-920c-272338c38f92', '0a0b22f6-0c17-4c4f-b9a1-67f9412915d6', 'de0daa9e-cc87-4ed5-b2c2-62782f3db523'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:35 devstack sudo[95319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:35 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:35 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e" returned: 0 in 0.709s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3b4f82-fb89-42b5-9743-7e6e621ee656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e163ddc-edc1-400c-b7df-016e1096b22e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5f0478-a293-4857-ab35-4b8c635e6789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Volume volume-7e163ddc-edc1-400c-b7df-016e1096b22e (7e163ddc-edc1-400c-b7df-016e1096b22e): created successfully
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5f0478-a293-4857-ab35-4b8c635e6789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Flow 'volume_create_manager' (131f265f-af0f-4b4c-aeec-b783760478c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7ace16a0-3f8e-4b63-973d-e56b8b1d03cf tempest-VolumesListAdminTestJSON-963805458 None] Created volume successfully.
Jun 01 01:49:36 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.932s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Deleted volume successfully.
Jun 01 01:49:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f2516dcb-fe12-4f89-bd41-2a9cfc4d3441 tempest-VolumesTestJSON-1238072481 None] Lock "cinder-92d7499d-598a-4ffb-b03f-08abd972f9f3-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Flow 'volume_create_manager' (b242d941-44c7-4aef-80aa-ad077c20f35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8213df0-e6c2-410c-8896-62f52dccc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8213df0-e6c2-410c-8896-62f52dccc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876187403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d34d079-a7d1-4786-9b9a-182812c82ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212345bf86d74a259afad162030f09ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:38Z,use_quota=True,user_id='3de8bd21534044b0985c88e2d38127e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b75951-f779-4de8-9c33-c915f056a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b75951-f779-4de8-9c33-c915f056a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fb692b-5c5f-492c-b0c7-9b7fdd018fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fb692b-5c5f-492c-b0c7-9b7fdd018fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d34d079-a7d1-4786-9b9a-182812c82ee1', 'volume_name': 'volume-1d34d079-a7d1-4786-9b9a-182812c82ee1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c975b063-7c2a-47f2-b2d8-529f94caddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c975b063-7c2a-47f2-b2d8-529f94caddbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f559e5a-ad35-452a-86c1-91ceacbc8b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Volume 1d34d079-a7d1-4786-9b9a-182812c82ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d34d079-a7d1-4786-9b9a-182812c82ee1', 'volume_size': 1}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876187403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d34d079-a7d1-4786-9b9a-182812c82ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212345bf86d74a259afad162030f09ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:38Z,use_quota=True,user_id='3de8bd21534044b0985c88e2d38127e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Creating volume 1d34d079-a7d1-4786-9b9a-182812c82ee1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:37 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:37 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1 1073741824
Jun 01 01:49:37 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:38 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1 1073741824" returned: 0 in 0.995s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:38 devstack sudo[95373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1
Jun 01 01:49:38 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:39 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f559e5a-ad35-452a-86c1-91ceacbc8b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d34d079-a7d1-4786-9b9a-182812c82ee1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc757a9-7d65-4747-8e67-9018d20c29e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Volume volume-1d34d079-a7d1-4786-9b9a-182812c82ee1 (1d34d079-a7d1-4786-9b9a-182812c82ee1): created successfully
Jun 01 01:49:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc757a9-7d65-4747-8e67-9018d20c29e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Flow 'volume_create_manager' (b242d941-44c7-4aef-80aa-ad077c20f35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-67f828aa-0d34-49ee-9249-42aa37625d7f tempest-VolumesListAdminTestJSON-963805458 None] Created volume successfully.
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-816e2d7f-5a34-43af-8632-3fd99b91a07d tempest-BackendsCapabilitiesAdminTestsJSON-641383092 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Flow 'volume_create_manager' (0fc816c5-9aaa-4123-9ddf-999ea0ff2cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4f4d43-b5e6-4d29-bac5-cf297c5ac3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4f4d43-b5e6-4d29-bac5-cf297c5ac3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-794605963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86639b8e-f1ec-4cf0-911e-cc77bb3fda7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212345bf86d74a259afad162030f09ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:41Z,use_quota=True,user_id='3de8bd21534044b0985c88e2d38127e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea722933-bb5e-45fd-850c-e775d983e27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea722933-bb5e-45fd-850c-e775d983e27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b3f4ad-8c70-4586-b2ed-e3741f987cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b3f4ad-8c70-4586-b2ed-e3741f987cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86639b8e-f1ec-4cf0-911e-cc77bb3fda7a', 'volume_name': 'volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73c233a-20d9-4741-b5be-67b10669856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73c233a-20d9-4741-b5be-67b10669856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c2b3d-d04c-4436-a8ef-5c496fff853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Volume 86639b8e-f1ec-4cf0-911e-cc77bb3fda7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a', 'volume_size': 1}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-794605963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86639b8e-f1ec-4cf0-911e-cc77bb3fda7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212345bf86d74a259afad162030f09ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:41Z,use_quota=True,user_id='3de8bd21534044b0985c88e2d38127e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Creating volume 86639b8e-f1ec-4cf0-911e-cc77bb3fda7a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:41 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:41 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a 1073741824
Jun 01 01:49:41 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-27a6738c-e9ae-469d-aa7f-f6af35167401 tempest-BackendsCapabilitiesAdminTestsJSON-641383092 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}}
Jun 01 01:49:42 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a 1073741824" returned: 0 in 0.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:42 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a
Jun 01 01:49:42 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:43 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a" returned: 0 in 0.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c2b3d-d04c-4436-a8ef-5c496fff853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fc5e4f-bfd2-43a6-9a1a-6643478080a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Volume volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a (86639b8e-f1ec-4cf0-911e-cc77bb3fda7a): created successfully
Jun 01 01:49:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fc5e4f-bfd2-43a6-9a1a-6643478080a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Flow 'volume_create_manager' (0fc816c5-9aaa-4123-9ddf-999ea0ff2cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b659f5aa-5bbe-4e94-9f55-c4e1004ea38f tempest-VolumesListAdminTestJSON-963805458 None] Created volume successfully.
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Flow 'volume_create_manager' (d5ba8999-a059-4bc5-8e84-98fdf8499116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43da24a-3be9-4e31-be12-783acc6b792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43da24a-3be9-4e31-be12-783acc6b792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b60f9f5172465da88288d8f31400da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:44Z,use_quota=True,user_id='b2dcee8631e146ac8225b0bf1e7e9383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635dd14f-fb83-4a39-a075-1ce840f106fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635dd14f-fb83-4a39-a075-1ce840f106fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aed81b8-5ac2-4923-9f78-6d26e2dbfbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aed81b8-5ac2-4923-9f78-6d26e2dbfbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1', 'volume_name': 'volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ee6bb6-ad57-49aa-9f12-2d2cc5ddd2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ee6bb6-ad57-49aa-9f12-2d2cc5ddd2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0938f2d-1908-4eb3-bc02-13051a4996ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Volume 6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1', 'volume_size': 1}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b60f9f5172465da88288d8f31400da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:44Z,use_quota=True,user_id='b2dcee8631e146ac8225b0bf1e7e9383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Creating volume 6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:44 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:44 devstack sudo[95389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 1073741824
Jun 01 01:49:44 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:45 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 1073741824" returned: 0 in 1.010s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:45 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1
Jun 01 01:49:45 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "cinder-be4aedfa-0869-4567-a85d-e9b190f6900f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-be4aedfa-0869-4567-a85d-e9b190f6900f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "cinder-quobyte-be4aedfa-0869-4567-a85d-e9b190f6900f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-quobyte-be4aedfa-0869-4567-a85d-e9b190f6900f" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ae44c-5f6f-424a-ae53-6d084f811056]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:46 devstack sudo[95397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f
Jun 01 01:49:46 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (e1253899-af94-4f08-9895-f41f0fbc77ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:46 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b92c1f-0aee-4c7f-a968-6882c564e617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1" returned: 0 in 0.874s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b92c1f-0aee-4c7f-a968-6882c564e617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-719136941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fc94da-fbab-44f7-a534-4eaa2b6d95cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:46Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfd812c-4aaf-446a-81dd-295cdc8756a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfd812c-4aaf-446a-81dd-295cdc8756a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb18ca47-7235-475f-ba59-a430daaa6977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb18ca47-7235-475f-ba59-a430daaa6977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83fc94da-fbab-44f7-a534-4eaa2b6d95cb', 'volume_name': 'volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b18d9b-9e41-462c-9251-2f1b11be3ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b18d9b-9e41-462c-9251-2f1b11be3ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e474c09-4b75-48ef-942c-72648328cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Volume 83fc94da-fbab-44f7-a534-4eaa2b6d95cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb', 'volume_size': 1}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-719136941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fc94da-fbab-44f7-a534-4eaa2b6d95cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:46Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Creating volume 83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:46 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0938f2d-1908-4eb3-bc02-13051a4996ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c780e23-e100-47ad-a33d-704192993616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:46 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb 1073741824
Jun 01 01:49:46 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Volume volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 (6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1): created successfully
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c780e23-e100-47ad-a33d-704192993616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Flow 'volume_create_manager' (d5ba8999-a059-4bc5-8e84-98fdf8499116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d00061b4-6eac-44c6-8e34-4c975e7b0839 tempest-VolumesListAdminTestJSON-315036178 None] Created volume successfully.
Jun 01 01:49:46 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f" returned: 0 in 1.034s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:47 devstack sudo[95441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f
Jun 01 01:49:47 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:47 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb 1073741824" returned: 0 in 0.953s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:47 devstack sudo[95446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb
Jun 01 01:49:47 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:47 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-be4aedfa-0869-4567-a85d-e9b190f6900f" returned: 0 in 0.694s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-quobyte-be4aedfa-0869-4567-a85d-e9b190f6900f" released by "delete_volume" :: held 1.798s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Acquiring lock "cinder-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Lock "cinder-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Acquiring lock "cinder-quobyte-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Created reservations ['8abffeca-8fc1-4c99-a27d-2cf5a60aa78d', 'ed110734-777a-4e96-aca9-493dbb1353cb', '06a2428a-3afc-4b57-aea6-bec0579385e4', '71ef4994-00d2-425a-a11b-493d499b3952'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Lock "cinder-quobyte-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1" acquired by "delete_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[917c8e42-780d-4151-bd2d-13437679d4db]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "cinder-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "cinder-quobyte-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:48 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:48 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:48 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1
Jun 01 01:49:48 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-quobyte-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fe66fd-6a97-4f84-9608-36dd2511cd06]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "cinder-c6d5b63d-cef4-4668-8dfb-f5ba006bb182-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-c6d5b63d-cef4-4668-8dfb-f5ba006bb182-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "cinder-quobyte-c6d5b63d-cef4-4668-8dfb-f5ba006bb182" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-quobyte-c6d5b63d-cef4-4668-8dfb-f5ba006bb182" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:48 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" returned: 0 in 0.826s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ae1d4-bde0-4fc8-bbc0-6f9ff42d5b84]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:48 devstack sudo[95454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a
Jun 01 01:49:48 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e474c09-4b75-48ef-942c-72648328cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df04ba2e-2db6-4a7c-98e7-76d9e1277f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Volume volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb (83fc94da-fbab-44f7-a534-4eaa2b6d95cb): created successfully
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df04ba2e-2db6-4a7c-98e7-76d9e1277f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (e1253899-af94-4f08-9895-f41f0fbc77ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fa1869b2-2e19-4117-9360-fc9d3396df16 tempest-VolumesSnapshotTestJSON-963163312 None] Created volume successfully.
Jun 01 01:49:48 devstack sudo[95456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182
Jun 01 01:49:48 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:49 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.976s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Deleted volume successfully.
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d94e5374-8232-4f84-ae2d-008730003290 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-be4aedfa-0869-4567-a85d-e9b190f6900f-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:49 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1" returned: 0 in 1.222s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:49 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1
Jun 01 01:49:49 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:49 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a" returned: 0 in 0.986s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:49 devstack sudo[95467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a
Jun 01 01:49:49 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:49 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182" returned: 0 in 1.160s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:49 devstack sudo[95474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182
Jun 01 01:49:49 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:49 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1" returned: 0 in 0.682s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Lock "cinder-quobyte-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1" released by "delete_volume" :: held 1.975s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Created reservations ['d8f1e4c2-d11c-49aa-b422-f0d95bda49c9', '158ab7ec-56b0-4bfb-a939-80f811ea9d27', 'e37d65ad-8640-4410-bbbb-1281b640306f', 'af8bd06c-4402-47db-be6f-a868588d3e7e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:49 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a" returned: 0 in 0.781s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-quobyte-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a" released by "delete_volume" :: held 1.835s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:50 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:50 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4ecade16-c04a-4124-8fb8-ddf0261c3627 tempest-GroupSnapshotsTest-1654961336 None] Group tempest-GroupSnapshotsTest-Group-1055318443: creating
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Created reservations ['61cc7712-a722-430f-bc3b-569ab0085281', '6b7c85dc-41a3-4090-b090-45eaea3c84db', '9f52f087-93f0-4906-9d93-75faf0dfc5f0', 'e690becc-a329-4a27-8dc4-3de5f5784514'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4ecade16-c04a-4124-8fb8-ddf0261c3627 tempest-GroupSnapshotsTest-1654961336 None] Group tempest-GroupSnapshotsTest-Group-1055318443: created successfully
Jun 01 01:49:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4ecade16-c04a-4124-8fb8-ddf0261c3627 tempest-GroupSnapshotsTest-1654961336 None] Create group completed successfully.
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:50 devstack sudo[95481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:50 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Creating offline snapshot 2a89197a-b421-45e0-bd48-5e026cd02e13 of volume 83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50b8a46-5210-4fb2-864f-7b4eae881677]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:50 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c6d5b63d-cef4-4668-8dfb-f5ba006bb182" returned: 0 in 0.875s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-quobyte-c6d5b63d-cef4-4668-8dfb-f5ba006bb182" released by "delete_volume" :: held 2.086s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Created reservations ['ac2fe20d-a0e2-43a7-9a73-e8afa9d30f9f', 'bdd147c7-6256-4995-a940-900bb5f9f3aa', 'a5f3be9d-dd91-4519-8fce-cd0b4385fe65', '18bee7db-cbb2-4278-bc56-9df77dd65d40'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:50 devstack sudo[95483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb
Jun 01 01:49:50 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:50 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:50 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:50 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Deleted volume successfully.
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b6faca20-74a4-49c4-8be3-44eb79b9f7d5 tempest-VolumesListAdminTestJSON-315036178 None] Lock "cinder-6a2d96cd-ee94-40f1-8b21-5ef8a99b65b1-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:50 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Deleted volume successfully.
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1a4903d7-80be-47b1-a3c5-7e98b8b07895 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-86639b8e-f1ec-4cf0-911e-cc77bb3fda7a-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:51 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" returned: 0 in 0.819s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:51 devstack sudo[95494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 1G
Jun 01 01:49:51 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:51 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Deleted volume successfully.
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-83ddac86-f65e-43f0-8011-e533cb1856b3 tempest-AttachVolumeShelveTestJSON-208892794 None] Lock "cinder-c6d5b63d-cef4-4668-8dfb-f5ba006bb182-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "cinder-1d34d079-a7d1-4786-9b9a-182812c82ee1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-1d34d079-a7d1-4786-9b9a-182812c82ee1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "cinder-quobyte-1d34d079-a7d1-4786-9b9a-182812c82ee1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-quobyte-1d34d079-a7d1-4786-9b9a-182812c82ee1" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315a95f-7bbf-4ba3-bc17-1fb3c9acbd51]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:51 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1
Jun 01 01:49:51 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (c198f844-ae43-4f8a-8bab-3b00c79144b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1fdbb1-7438-403f-8aa9-5ae1b0592dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1fdbb1-7438-403f-8aa9-5ae1b0592dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178282337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4cb6151f-9787-4980-84fc-34d260c35329,host='devstack@QuobyteHD#QuobyteHD',id=80fe5b9d-5241-42d2-8379-898ebdf39cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:52Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8037eb92-03d8-4901-9b75-a98494cbc441),volume_type_id=8037eb92-03d8-4901-9b75-a98494cbc441)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152bbf77-1146-4cd9-bfc3-06f61fefb725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152bbf77-1146-4cd9-bfc3-06f61fefb725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ad5074-c883-4cbf-91d8-ffc99be6150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ad5074-c883-4cbf-91d8-ffc99be6150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fe5b9d-5241-42d2-8379-898ebdf39cbd', 'volume_name': 'volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6348b2bc-7a10-416f-a864-e8d5712a8f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6348b2bc-7a10-416f-a864-e8d5712a8f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb24cde-daa7-4975-abb1-4bb524222363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Volume 80fe5b9d-5241-42d2-8379-898ebdf39cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd', 'volume_size': 1}
Jun 01 01:49:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:52 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 1G" returned: 0 in 0.910s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:52 devstack sudo[95503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13
Jun 01 01:49:52 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:52 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1" returned: 0 in 0.848s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:52 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1
Jun 01 01:49:52 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:52 devstack sudo[95509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:52 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:52 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13" returned: 0 in 0.821s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:52 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 is being set with open permissions: ugo+rw
Jun 01 01:49:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:52 devstack sudo[95521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13
Jun 01 01:49:52 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:53 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1d34d079-a7d1-4786-9b9a-182812c82ee1" returned: 0 in 0.787s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-quobyte-1d34d079-a7d1-4786-9b9a-182812c82ee1" released by "delete_volume" :: held 1.690s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:53 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.810s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Created reservations ['b8fe433e-7d4f-4630-a1d1-dc69faae763e', '5af8035a-3bdf-4a86-a845-656053528863', '42e1f72b-4944-46bc-922b-2f2e79c2d3f1', '6640c0c1-a19c-4f7f-be1e-e6a359743622'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:53 devstack sudo[95526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:53 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:53 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13" returned: 0 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:53 devstack sudo[95536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.info
Jun 01 01:49:53 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "cinder-7e163ddc-edc1-400c-b7df-016e1096b22e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-7e163ddc-edc1-400c-b7df-016e1096b22e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "cinder-quobyte-7e163ddc-edc1-400c-b7df-016e1096b22e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-quobyte-7e163ddc-edc1-400c-b7df-016e1096b22e" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa0639-89ad-4bba-bbe6-a73e02de8298]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:54 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:54 devstack sudo[95538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e
Jun 01 01:49:54 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Deleted volume successfully.
Jun 01 01:49:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-45af7af7-05a2-4e78-8d39-510d6a5f1e61 tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-1d34d079-a7d1-4786-9b9a-182812c82ee1-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:54 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.info" returned: 0 in 0.691s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:54 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.info is being set with open permissions: ugo+rw
Jun 01 01:49:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:54 devstack sudo[95542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.info
Jun 01 01:49:54 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:54 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e" returned: 0 in 0.845s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:54 devstack sudo[95547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e
Jun 01 01:49:54 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:55 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.info" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.777s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.213s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4cb6151f-9787-4980-84fc-34d260c35329,created_at=2026-05-31T23:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178282337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4cb6151f-9787-4980-84fc-34d260c35329,host='devstack@QuobyteHD#QuobyteHD',id=80fe5b9d-5241-42d2-8379-898ebdf39cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:49:52Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8037eb92-03d8-4901-9b75-a98494cbc441),volume_type_id=8037eb92-03d8-4901-9b75-a98494cbc441)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Creating volume 80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:49:55 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:55 devstack sudo[95550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd 1073741824
Jun 01 01:49:55 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c3e8c01d-3033-4aa1-9a8f-6d861977102f tempest-VolumesSnapshotTestJSON-963163312 None] Create snapshot completed successfully
Jun 01 01:49:55 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e163ddc-edc1-400c-b7df-016e1096b22e" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-quobyte-7e163ddc-edc1-400c-b7df-016e1096b22e" released by "delete_volume" :: held 1.588s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Created reservations ['cb125ceb-10ec-45a1-8a20-6efeff43f2ec', 'fbe5036f-36db-4028-8231-b9be2fccffd0', '3e688ce3-85f7-4764-874a-6771346d0c6a', '99db76a5-7645-483d-a9db-22f29846a002'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:55 devstack sudo[95553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:49:55 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-2a89197a-b421-45e0-bd48-5e026cd02e13-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-2a89197a-b421-45e0-bd48-5e026cd02e13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-2a89197a-b421-45e0-bd48-5e026cd02e13" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-2a89197a-b421-45e0-bd48-5e026cd02e13" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Deleting offline snapshot 2a89197a-b421-45e0-bd48-5e026cd02e13 of volume 83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] snapshot_file for this snap is: volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[432611f6-c6fc-4355-9d72-b6c211580bc8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:56 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13
Jun 01 01:49:56 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:56 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd 1073741824" returned: 0 in 1.108s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:56 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd
Jun 01 01:49:56 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:56 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.764s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:49:56 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Deleted volume successfully.
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-20fb4c1a-367e-4f14-9d7b-26010517e8ac tempest-VolumesListAdminTestJSON-963805458 None] Lock "cinder-7e163ddc-edc1-400c-b7df-016e1096b22e-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:56 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13" returned: 0 in 0.959s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1a6fe2-1810-4a3d-93c4-cd6d7c901af1]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:57 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb
Jun 01 01:49:57 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:57 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb24cde-daa7-4975-abb1-4bb524222363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a88ede-3934-4c52-a479-70af015ce85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:49:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Volume volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd (80fe5b9d-5241-42d2-8379-898ebdf39cbd): created successfully
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a88ede-3934-4c52-a479-70af015ce85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (c198f844-ae43-4f8a-8bab-3b00c79144b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:49:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-de81df45-2be1-4721-8d76-7cd87226f79a tempest-GroupSnapshotsTest-1654961336 None] Created volume successfully.
Jun 01 01:49:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] GroupSnapshot 8501fc1b-aba6-427a-9f1d-3351f652afa7: creating.
Jun 01 01:49:57 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" returned: 0 in 0.924s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Group snapshot 8501fc1b-aba6-427a-9f1d-3351f652afa7: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:49:57 devstack sudo[95576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13
Jun 01 01:49:57 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Creating offline snapshot d43e09e6-1aba-4d9e-8cf6-01ccc559278a of volume 80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19fc9f-3bb0-497c-87d3-fd1e9f329c98]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:49:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:58 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd
Jun 01 01:49:58 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:58 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13" returned: 0 in 0.808s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:58 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13
Jun 01 01:49:58 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:58 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd" returned: 0 in 0.962s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:58 devstack sudo[95589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a 1G
Jun 01 01:49:58 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:49:59 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb.2a89197a-b421-45e0-bd48-5e026cd02e13" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-2a89197a-b421-45e0-bd48-5e026cd02e13" released by "_delete_snapshot" :: held 3.597s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" released by "delete_snapshot" :: held 3.646s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:59 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['dcaf8867-4247-4eab-8f7b-7ca8dbf08a5a', 'c6d19de3-ea0b-4d78-82ec-1054a3d4e728', '93f7a90b-d343-48e5-8f6a-a91d5c46996c', 'cd55a42d-6b29-488c-810d-153f84ec98f3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:49:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Delete snapshot completed successfully.
Jun 01 01:49:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-31fe6987-46c8-42a0-8bfc-6440f03344ae tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-2a89197a-b421-45e0-bd48-5e026cd02e13-delete_snapshot" released by "delete_snapshot" :: held 3.862s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:49:59 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root
Jun 01 01:49:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a 1G" returned: 0 in 1.013s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:49:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:49:59 devstack sudo[95596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a
Jun 01 01:49:59 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:00 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (8085963d-5f37-4dc2-97d9-3c87c175e78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8764cf1-fd35-481f-9265-7998046d0bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a" returned: 0 in 0.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:00 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8764cf1-fd35-481f-9265-7998046d0bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-843301301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9b3531-0627-438f-9341-6344d878c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:01Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18d1d55-6689-4317-b42b-776f2c6d67c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18d1d55-6689-4317-b42b-776f2c6d67c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:00 devstack sudo[95603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a
Jun 01 01:50:00 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f536a3-3d56-4063-9312-1c15d196a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f536a3-3d56-4063-9312-1c15d196a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9b3531-0627-438f-9341-6344d878c0de', 'volume_name': 'volume-0e9b3531-0627-438f-9341-6344d878c0de', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8e72e1-fa2f-4951-9792-acf3b48478c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8e72e1-fa2f-4951-9792-acf3b48478c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e6a9b4-e238-4c5a-8235-fe2f2bd8b7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Volume 0e9b3531-0627-438f-9341-6344d878c0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9b3531-0627-438f-9341-6344d878c0de', 'volume_size': 1}
Jun 01 01:50:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:01 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:01 devstack sudo[95607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.info
Jun 01 01:50:01 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Flow 'volume_create_manager' (6b7f5995-19cb-448d-8ff8-f9036ea08673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02331851-4c3a-41b0-a279-df3e96f2b75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02331851-4c3a-41b0-a279-df3e96f2b75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1092795021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fad79ee-ebf5-419c-a9b1-7da46854ccf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed42e9f041741bb9c08efebf22f3ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:02Z,use_quota=True,user_id='223d13f4cbc6454e8499b67a2a81d840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5a3260-db62-4b4d-b119-f921cc8adc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5a3260-db62-4b4d-b119-f921cc8adc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68f5dcb-15d7-4a37-bc49-c36ebb29c51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:01 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68f5dcb-15d7-4a37-bc49-c36ebb29c51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6fad79ee-ebf5-419c-a9b1-7da46854ccf1', 'volume_name': 'volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x728655bcdac0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc295b9-745b-4e87-a158-aefe70f0709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc295b9-745b-4e87-a158-aefe70f0709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f5d608-105d-4a58-a819-83fed8bd4ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:02 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Volume 6fad79ee-ebf5-419c-a9b1-7da46854ccf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x728655bcdac0>}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Trying to clone 6fad79ee-ebf5-419c-a9b1-7da46854ccf1 from image e56da659-fc04-4789-a705-f5b7a7a6ddfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 01:50:02 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.info" returned: 0 in 0.642s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:02 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:02 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.info
Jun 01 01:50:02 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 01:50:02 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Image download 20.69 MB at 20.69 MB/s
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[644e47b6-30e2-47d0-b261-f352e9d2e579]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:02 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD
Jun 01 01:50:02 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:02 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.info" returned: 0 in 0.671s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.944s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-843301301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9b3531-0627-438f-9341-6344d878c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:01Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Creating volume 0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:02 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:02 devstack sudo[95617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de 1073741824
Jun 01 01:50:02 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a18e5afb-6d65-4e5b-8f32-30c68f8d52a5 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 8501fc1b-aba6-427a-9f1d-3351f652afa7: created successfully
Jun 01 01:50:03 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:03 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd is fetched for user 223d13f4cbc6454e8499b67a2a81d840. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 01:50:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[424237a7-99a9-4196-8123-f88bcbd4eaee]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:03 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD
Jun 01 01:50:03 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:03 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de 1073741824" returned: 0 in 0.886s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:03 devstack sudo[95628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de
Jun 01 01:50:03 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:04 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Flow 'volume_create_manager' (909c8039-81d5-4c84-863d-9ac26721a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4838b5-55af-40f5-bec4-319b43317103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4838b5-55af-40f5-bec4-319b43317103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1898819773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831fa271-7b4f-4aac-aad0-a96a555a60ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be596c68276d4ed8bddb1739bc7bc5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:04Z,use_quota=True,user_id='d80009c5fd1643c78613bb870e91a450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea2e0bf-60e3-49f6-bd13-470b8061bd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea2e0bf-60e3-49f6-bd13-470b8061bd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdf5e39-a2a8-4d8c-818b-08cccff2e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdf5e39-a2a8-4d8c-818b-08cccff2e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831fa271-7b4f-4aac-aad0-a96a555a60ee', 'volume_name': 'volume-831fa271-7b4f-4aac-aad0-a96a555a60ee', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c38a48-3717-4581-875f-207a7ef1a0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c38a48-3717-4581-875f-207a7ef1a0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bd4d22-d2fc-4b8e-a95f-19f8f158f92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Volume 831fa271-7b4f-4aac-aad0-a96a555a60ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831fa271-7b4f-4aac-aad0-a96a555a60ee', 'volume_size': 1}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:04 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1092795021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fad79ee-ebf5-419c-a9b1-7da46854ccf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ed42e9f041741bb9c08efebf22f3ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:02Z,use_quota=True,user_id='223d13f4cbc6454e8499b67a2a81d840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Creating volume 6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:04 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e6a9b4-e238-4c5a-8235-fe2f2bd8b7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9b3531-0627-438f-9341-6344d878c0de', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a54fab-2bd5-438a-ba24-62d4325d2bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:04 devstack sudo[95634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 1073741824
Jun 01 01:50:04 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Volume volume-0e9b3531-0627-438f-9341-6344d878c0de (0e9b3531-0627-438f-9341-6344d878c0de): created successfully
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a54fab-2bd5-438a-ba24-62d4325d2bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (8085963d-5f37-4dc2-97d9-3c87c175e78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1ffc0da3-9c1f-49fe-8ff4-6b8b1bd2b61c tempest-VolumesSnapshotTestJSON-963163312 None] Created volume successfully.
Jun 01 01:50:05 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 1073741824" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:05 devstack sudo[95639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1
Jun 01 01:50:05 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:05 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" returned: 0 in 0.605s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1898819773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831fa271-7b4f-4aac-aad0-a96a555a60ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be596c68276d4ed8bddb1739bc7bc5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:04Z,use_quota=True,user_id='d80009c5fd1643c78613bb870e91a450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Creating volume 831fa271-7b4f-4aac-aad0-a96a555a60ee {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:05 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:05 devstack sudo[95642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee 1073741824
Jun 01 01:50:05 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:05 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Attempting download of e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume 6fad79ee-ebf5-419c-a9b1-7da46854ccf1. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 01:50:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be47df5e-923a-45ce-8fc7-13a242738b06]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_8t_hln92 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:06 devstack sudo[95644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_8t_hln92
Jun 01 01:50:06 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:06 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee 1073741824" returned: 0 in 0.773s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:06 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_8t_hln92" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_8t_hln92 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:06 devstack sudo[95652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee
Jun 01 01:50:06 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:06 devstack sudo[95651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_8t_hln92
Jun 01 01:50:06 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:07 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee" returned: 0 in 0.603s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.900s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-d43e09e6-1aba-4d9e-8cf6-01ccc559278a-c7f17360-cab9-4df8-b515-3e08210a1501" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bd4d22-d2fc-4b8e-a95f-19f8f158f92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831fa271-7b4f-4aac-aad0-a96a555a60ee', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111404c5-98ef-455b-9d26-c1023430ff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-d43e09e6-1aba-4d9e-8cf6-01ccc559278a-c7f17360-cab9-4df8-b515-3e08210a1501" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Creating volume c7f17360-cab9-4df8-b515-3e08210a1501 from snapshot d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:07 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-c7f17360-cab9-4df8-b515-3e08210a1501" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Volume volume-831fa271-7b4f-4aac-aad0-a96a555a60ee (831fa271-7b4f-4aac-aad0-a96a555a60ee): created successfully
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111404c5-98ef-455b-9d26-c1023430ff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Flow 'volume_create_manager' (909c8039-81d5-4c84-863d-9ac26721a130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_8t_hln92" returned: 1 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_8t_hln92' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d32b7-4bd1-48d5-9efc-50ef3dd33666]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-c7f17360-cab9-4df8-b515-3e08210a1501" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] snapshot: d43e09e6-1aba-4d9e-8cf6-01ccc559278a, volume: c7f17360-cab9-4df8-b515-3e08210a1501,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:50:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a0eb16d3-53c7-4651-8517-1be2b7e26d4d tempest-VolumesTransfersTest-1696778610 None] Created volume successfully.
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3642cff-cbd7-4886-bdb4-c2e7e6f64a3a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:07 devstack sudo[95658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD
Jun 01 01:50:07 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:07 devstack sudo[95659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a
Jun 01 01:50:07 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:08 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] e56da659-fc04-4789-a705-f5b7a7a6ddfd was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7190674f-e3f8-4f7a-a95f-f6c0f68c0b57 tempest-VolumesTransfersTest-1103498819 None] Transfer volume completed successfully.
Jun 01 01:50:08 devstack sudo[95668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1
Jun 01 01:50:08 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:08 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a" returned: 0 in 0.780s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa512b6-484e-437e-bd36-2b9dcbaa74e6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:08 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd
Jun 01 01:50:08 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:09 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd" returned: 0 in 0.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Acquiring lock "cinder-831fa271-7b4f-4aac-aad0-a96a555a60ee-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:09 devstack sudo[95683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501
Jun 01 01:50:09 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Lock "cinder-831fa271-7b4f-4aac-aad0-a96a555a60ee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Acquiring lock "cinder-quobyte-831fa271-7b4f-4aac-aad0-a96a555a60ee" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Lock "cinder-quobyte-831fa271-7b4f-4aac-aad0-a96a555a60ee" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7257fd15-6c77-4390-86c8-23d388af6b5c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:09 devstack sudo[95685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee
Jun 01 01:50:09 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:10 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee" returned: 0 in 0.869s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:10 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee
Jun 01 01:50:10 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:10 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" returned: 0 in 2.132s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:10 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_nagbtrfmdevstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:50:10 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Converted 112.00 MB image at 52.45 MB/s
Jun 01 01:50:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:10 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 1G
Jun 01 01:50:10 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:11 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-831fa271-7b4f-4aac-aad0-a96a555a60ee" returned: 0 in 1.268s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Lock "cinder-quobyte-831fa271-7b4f-4aac-aad0-a96a555a60ee" released by "delete_volume" :: held 2.195s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Created reservations ['54c4dcda-69c6-462d-99b7-3f83ddc1e836', '08dd26a2-6625-4b0a-9771-407797694cc8', 'ef677bcf-c57c-4434-b93b-96a4d9adf56c', 'c7b76974-54bb-418f-a767-10b191fecf9b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:11 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:11 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:12 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 1G" returned: 0 in 1.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[739bc4af-6ded-4fca-97dc-395ebdc10999]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:12 devstack sudo[95724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1
Jun 01 01:50:12 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:13 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.475s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Deleted volume successfully.
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-85471e11-6922-4ebf-a898-ca51e60539cf tempest-VolumesTransfersTest-884752623 None] Lock "cinder-831fa271-7b4f-4aac-aad0-a96a555a60ee-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Flow 'volume_create_manager' (e437800d-6fca-4f82-847a-bf340ee727a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b7f4eb-a083-44ac-bb5a-47b54e15c15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b7f4eb-a083-44ac-bb5a-47b54e15c15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1964619509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775a436e-43ab-4acf-b78c-7ce2bae26328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be596c68276d4ed8bddb1739bc7bc5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:14Z,use_quota=True,user_id='d80009c5fd1643c78613bb870e91a450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e157d87-457d-49cd-8eda-425e7ff0ac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e157d87-457d-49cd-8eda-425e7ff0ac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206163f6-a15e-410c-a5a2-b2bbb06b73db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206163f6-a15e-410c-a5a2-b2bbb06b73db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775a436e-43ab-4acf-b78c-7ce2bae26328', 'volume_name': 'volume-775a436e-43ab-4acf-b78c-7ce2bae26328', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64e085e-c8ab-46f7-a9c8-17d64afc3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64e085e-c8ab-46f7-a9c8-17d64afc3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301cae0d-c83c-4de0-b652-fbe9fb26c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Volume 775a436e-43ab-4acf-b78c-7ce2bae26328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775a436e-43ab-4acf-b78c-7ce2bae26328', 'volume_size': 1}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:13 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" returned: 0 in 1.848s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:14 devstack sudo[95729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1
Jun 01 01:50:14 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:15 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" returned: 1 in 1.238s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Downloaded image e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume 6fad79ee-ebf5-419c-a9b1-7da46854ccf1 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd for user 223d13f4cbc6454e8499b67a2a81d840 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Marking volume 6fad79ee-ebf5-419c-a9b1-7da46854ccf1 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Copying metadata from image e56da659-fc04-4789-a705-f5b7a7a6ddfd to 6fad79ee-ebf5-419c-a9b1-7da46854ccf1. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Creating volume glance metadata for volume 6fad79ee-ebf5-419c-a9b1-7da46854ccf1 backed by image e56da659-fc04-4789-a705-f5b7a7a6ddfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 01:50:15 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501" returned: 0 in 6.113s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a461c55-0ede-49ee-909a-41464db31b13]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f5d608-105d-4a58-a819-83fed8bd4ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x728655bcdac0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3188830d-debf-4903-9ef3-dde48574183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Volume volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 (6fad79ee-ebf5-419c-a9b1-7da46854ccf1): created successfully
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3188830d-debf-4903-9ef3-dde48574183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Flow 'volume_create_manager' (6b7f5995-19cb-448d-8ff8-f9036ea08673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e3662c7a-370b-4d67-8a05-2ac483200229 tempest-VolumesImageMetadata-692998005 None] Created volume successfully.
Jun 01 01:50:15 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd
Jun 01 01:50:15 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:16 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd" returned: 0 in 0.886s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:50:16 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Converted 1024.00 MB image at 167.49 MB/s
Jun 01 01:50:16 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501 is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:16 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501
Jun 01 01:50:16 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:16 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501" returned: 0 in 0.570s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Acquiring lock "cinder-6fad79ee-ebf5-419c-a9b1-7da46854ccf1-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-c7f17360-cab9-4df8-b515-3e08210a1501" released by "_copy_volume_from_snapshot" :: held 9.294s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-d43e09e6-1aba-4d9e-8cf6-01ccc559278a-c7f17360-cab9-4df8-b515-3e08210a1501" released by "_create_volume_from_snapshot" :: held 9.353s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.387s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.206s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Lock "cinder-6fad79ee-ebf5-419c-a9b1-7da46854ccf1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=129,cinder:UPDATE=167,cinder:INSERT=48,cinder:DELETE=11 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=129,cinder:DELETE=16,cinder:UPDATE=146,cinder:INSERT=37 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Creating offline snapshot a44ca52c-4739-4bb3-aa87-60e9aba3ee17 of volume 0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b86a6-4d06-4975-98cb-28c2947680ae]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Acquiring lock "cinder-quobyte-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:16 devstack sudo[95742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de
Jun 01 01:50:16 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Lock "cinder-quobyte-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-920bf45f-7eb0-4a80-9051-c2fd1c410f1d tempest-GroupSnapshotsTest-1654961336 None] Create group from source-snapshot-8501fc1b-aba6-427a-9f1d-3351f652afa7 completed successfully.
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb4a54c-eb95-4e88-b716-5cf4f82102f9]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:17 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1
Jun 01 01:50:17 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-c7f17360-cab9-4df8-b515-3e08210a1501" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-c7f17360-cab9-4df8-b515-3e08210a1501" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[af75ab63-e088-459d-816a-2211f133da1d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:17 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:17 devstack sudo[95751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 1G
Jun 01 01:50:17 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:17 devstack sudo[95749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501
Jun 01 01:50:17 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:17 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:17 devstack sudo[95755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1
Jun 01 01:50:17 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:18 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501" returned: 0 in 0.727s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:18 devstack sudo[95763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501
Jun 01 01:50:18 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:18 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 1G" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9b3531-0627-438f-9341-6344d878c0de -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:18 devstack sudo[95768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9b3531-0627-438f-9341-6344d878c0de -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17
Jun 01 01:50:18 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:18 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" returned: 1 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:18 devstack sudo[95770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1
Jun 01 01:50:18 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:18 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c7f17360-cab9-4df8-b515-3e08210a1501" returned: 0 in 0.598s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-c7f17360-cab9-4df8-b515-3e08210a1501" released by "delete_volume" :: held 1.376s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:18 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['f08ee805-68af-4c1f-be75-5e771d8bbdbe'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:18 devstack cinder-volume[86676]: WARNING cinder.quota [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1802381192 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1802381192, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:50:18 devstack cinder-volume[86676]: WARNING cinder.quota [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1802381192 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1802381192, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:50:18 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9b3531-0627-438f-9341-6344d878c0de -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 is being set with open permissions: ugo+rw
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['b1150375-f6df-41f5-817e-ec6ab55d0880', 'd2f2a559-7a7e-44bb-ac73-fe8d1ba1b200', 'da03f204-c1e6-4776-acbc-a842d66f4547', 'c0805b4a-d5cf-4d37-88aa-26e95ade780d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:19 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17
Jun 01 01:50:19 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:19 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" returned: 0 in 0.662s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Lock "cinder-quobyte-6fad79ee-ebf5-419c-a9b1-7da46854ccf1" released by "delete_volume" :: held 2.185s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Created reservations ['76edbef5-082a-48a9-8e90-4c05e5a69d0c', 'd69beb3c-3964-42c9-add2-53f6432adba3', '2eb20b4f-0c8e-40fc-80a4-a5dc9a88c88a', '89f784c6-b4fe-4d24-9780-0da718e9d5b3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:19 devstack sudo[95779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:19 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:19 devstack sudo[95781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:19 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:19 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17" returned: 0 in 0.617s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:19 devstack sudo[95785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.info
Jun 01 01:50:19 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 8501fc1b-aba6-427a-9f1d-3351f652afa7: deleting
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 8501fc1b-aba6-427a-9f1d-3351f652afa7: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-80fe5b9d-5241-42d2-8379-898ebdf39cbd" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:19 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2de03caa-0f18-4529-b18d-87002c4936a3 tempest-GroupSnapshotsTest-1654961336 None] Delete group completed successfully.
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-80fe5b9d-5241-42d2-8379-898ebdf39cbd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-d43e09e6-1aba-4d9e-8cf6-01ccc559278a" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-d43e09e6-1aba-4d9e-8cf6-01ccc559278a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Deleting offline snapshot d43e09e6-1aba-4d9e-8cf6-01ccc559278a of volume 80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] snapshot_file for this snap is: volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[201da554-5934-494d-9da1-2fe68d159cae]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:19 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:19 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Deleted volume successfully.
Jun 01 01:50:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-70aacb29-932a-44eb-9177-046097460a9a tempest-VolumesImageMetadata-692998005 None] Lock "cinder-6fad79ee-ebf5-419c-a9b1-7da46854ccf1-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:20 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a
Jun 01 01:50:20 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:20 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.info" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:20 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.info is being set with open permissions: ugo+rw
Jun 01 01:50:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:20 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.info
Jun 01 01:50:20 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:20 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a" returned: 0 in 0.742s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:50:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a8a769-90b1-4ded-a0bb-5f06e4624483]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:20 devstack sudo[95797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd
Jun 01 01:50:20 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:20 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.info" returned: 0 in 0.613s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.285s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.218s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1964619509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775a436e-43ab-4acf-b78c-7ce2bae26328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be596c68276d4ed8bddb1739bc7bc5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:14Z,use_quota=True,user_id='d80009c5fd1643c78613bb870e91a450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Creating volume 775a436e-43ab-4acf-b78c-7ce2bae26328 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:21 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:21 devstack sudo[95800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328 1073741824
Jun 01 01:50:21 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8e1e0242-914c-4a57-95da-38c3069876b7 tempest-VolumesSnapshotTestJSON-963163312 None] Create snapshot completed successfully
Jun 01 01:50:21 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd" returned: 0 in 0.899s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:21 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a
Jun 01 01:50:21 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (6626981b-b839-4bd5-b246-b2d2b8ab8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1202ca73-3266-4217-b9c2-705d29c35745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1202ca73-3266-4217-b9c2-705d29c35745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1711217359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8d2d65-c17e-4098-a84d-644c6767cc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a44ca52c-4739-4bb3-aa87-60e9aba3ee17,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:22Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebc2dd5-45c3-45a9-9ec8-08fb80dac77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebc2dd5-45c3-45a9-9ec8-08fb80dac77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e91939-14c0-4291-b07d-2d892f343e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e91939-14c0-4291-b07d-2d892f343e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd8d2d65-c17e-4098-a84d-644c6767cc38', 'volume_name': 'volume-fd8d2d65-c17e-4098-a84d-644c6767cc38', 'volume_size': 2, 'snapshot_id': 'a44ca52c-4739-4bb3-aa87-60e9aba3ee17'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4286b97-2f73-4719-b061-f01559f0cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4286b97-2f73-4719-b061-f01559f0cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74acc85-f380-4451-abe4-e869eb70de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Volume fd8d2d65-c17e-4098-a84d-644c6767cc38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd8d2d65-c17e-4098-a84d-644c6767cc38', 'volume_size': 2, 'snapshot_id': 'a44ca52c-4739-4bb3-aa87-60e9aba3ee17'}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:22 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328 1073741824" returned: 0 in 1.078s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:22 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328
Jun 01 01:50:22 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:22 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a" returned: 0 in 0.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:22 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a
Jun 01 01:50:22 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:22 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328" returned: 0 in 0.640s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.739s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-a44ca52c-4739-4bb3-aa87-60e9aba3ee17-fd8d2d65-c17e-4098-a84d-644c6767cc38" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301cae0d-c83c-4de0-b652-fbe9fb26c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775a436e-43ab-4acf-b78c-7ce2bae26328', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db63c3ff-73de-4f73-bb10-4ee06291d86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-a44ca52c-4739-4bb3-aa87-60e9aba3ee17-fd8d2d65-c17e-4098-a84d-644c6767cc38" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Creating volume fd8d2d65-c17e-4098-a84d-644c6767cc38 from snapshot a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-fd8d2d65-c17e-4098-a84d-644c6767cc38" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Volume volume-775a436e-43ab-4acf-b78c-7ce2bae26328 (775a436e-43ab-4acf-b78c-7ce2bae26328): created successfully
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db63c3ff-73de-4f73-bb10-4ee06291d86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Flow 'volume_create_manager' (e437800d-6fca-4f82-847a-bf340ee727a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fd8d2d65-c17e-4098-a84d-644c6767cc38" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] snapshot: a44ca52c-4739-4bb3-aa87-60e9aba3ee17, volume: fd8d2d65-c17e-4098-a84d-644c6767cc38,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:50:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dad6b66b-fa1f-473c-bf71-278fed526b5c tempest-VolumesTransfersTest-1696778610 None] Created volume successfully.
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a051fd7-f404-4c98-94a3-b1ab4727d1ec]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:23 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd.d43e09e6-1aba-4d9e-8cf6-01ccc559278a" returned: 0 in 0.683s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-d43e09e6-1aba-4d9e-8cf6-01ccc559278a" released by "_delete_snapshot" :: held 3.274s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-80fe5b9d-5241-42d2-8379-898ebdf39cbd" released by "delete_snapshot" :: held 3.304s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:23 devstack sudo[95822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17
Jun 01 01:50:23 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Flow 'volume_create_manager' (8f2ede43-3ff3-43cc-acf9-4b9dd21eb220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea737788-ab29-42b5-924f-fa173f4a77e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:23 devstack cinder-volume[86676]: WARNING cinder.quota [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1802381192 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1802381192, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea737788-ab29-42b5-924f-fa173f4a77e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1086780710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc3ce35-75e5-4675-b52e-b4661877e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273d553a114a4d3ab9cbd5b8935bb8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:23Z,use_quota=True,user_id='4db752b1497e4cc792d1b3fe2e4df61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b442085a-695b-4da0-8819-72850dcf191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b442085a-695b-4da0-8819-72850dcf191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72d3cea-4481-4c57-ac6f-d5f4c85660d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72d3cea-4481-4c57-ac6f-d5f4c85660d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc3ce35-75e5-4675-b52e-b4661877e97c', 'volume_name': 'volume-edc3ce35-75e5-4675-b52e-b4661877e97c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18952612-a31b-48c8-81f9-1e6d4bc2e486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18952612-a31b-48c8-81f9-1e6d4bc2e486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ecc534-a81b-46a4-8295-890b96f31b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:23 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Volume edc3ce35-75e5-4675-b52e-b4661877e97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc3ce35-75e5-4675-b52e-b4661877e97c', 'volume_size': 1}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['73352efb-f0d7-4e44-a878-c62d90248fe0', '6f61c0f7-2d79-4a67-a239-16dda2855647', 'c1ee7989-751b-4fb2-979b-5bf7de983879', '4e804b25-5a31-4ae1-9f4b-47c27c0454f5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-77ba12fd-76f4-42cf-9dff-a668528eff93 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 8501fc1b-aba6-427a-9f1d-3351f652afa7: deleted successfully
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Acquiring lock "cinder-775a436e-43ab-4acf-b78c-7ce2bae26328-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Lock "cinder-775a436e-43ab-4acf-b78c-7ce2bae26328-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Acquiring lock "cinder-quobyte-775a436e-43ab-4acf-b78c-7ce2bae26328" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Lock "cinder-quobyte-775a436e-43ab-4acf-b78c-7ce2bae26328" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056c3c9-206a-402f-a56f-5eb2b0bb64d2]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:23 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17" returned: 0 in 0.859s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e9b3531-0627-438f-9341-6344d878c0de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b447516-6316-488a-901b-837bba477bec]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:23 devstack sudo[95827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328
Jun 01 01:50:23 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:23 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de
Jun 01 01:50:23 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-80fe5b9d-5241-42d2-8379-898ebdf39cbd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-80fe5b9d-5241-42d2-8379-898ebdf39cbd" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[168aacaf-61c8-4c6b-9786-c76f76b1bc6a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:24 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de" returned: 0 in 0.755s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:24 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:24 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd
Jun 01 01:50:24 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:24 devstack sudo[95839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38
Jun 01 01:50:24 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:24 devstack sudo[95841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328
Jun 01 01:50:24 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:25 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-775a436e-43ab-4acf-b78c-7ce2bae26328" returned: 0 in 0.664s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:25 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd" returned: 0 in 0.831s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Lock "cinder-quobyte-775a436e-43ab-4acf-b78c-7ce2bae26328" released by "delete_volume" :: held 1.551s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:25 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd
Jun 01 01:50:25 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Created reservations ['35b8744c-138b-4ffb-80d8-251faa19ecf2', 'a0e5cab2-c5a2-4d28-ac61-746ea4d2bda8', '7b1a750a-bf34-420c-baf7-976da848352f', '3e93d00c-2a8f-4a85-a940-f6d38dfe040d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:25 devstack sudo[95856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:25 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:27 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:27 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Deleted volume successfully.
Jun 01 01:50:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3ba875dd-4375-44a8-b6ae-8de08d986a56 tempest-VolumesTransfersTest-884752623 None] Lock "cinder-775a436e-43ab-4acf-b78c-7ce2bae26328-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:27 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80fe5b9d-5241-42d2-8379-898ebdf39cbd" returned: 0 in 2.247s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-80fe5b9d-5241-42d2-8379-898ebdf39cbd" released by "delete_volume" :: held 3.195s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:27 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['6c10c7fb-cd2f-420c-ba0a-d85db01bd20e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:27 devstack cinder-volume[86676]: WARNING cinder.db.sqlalchemy.api [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1802381192']
Jun 01 01:50:27 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['5889c684-ff0e-4c1a-9c34-45b9ebcc80c9', '30d2e4b4-2d66-4d51-8bfe-24f73216d4bb', '30775da4-d50c-4b89-913b-e444a52231e8', 'eb3889a1-4ceb-4482-a8b1-83371055cbb6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:28 devstack sudo[95866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:28 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:29 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:29 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8586b5c4-b344-456a-a8b7-c1a134a20968 tempest-GroupSnapshotsTest-1654961336 None] Delete group completed successfully.
Jun 01 01:50:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6dbb8153-a5ee-407d-b03a-a57fd2afccb7 tempest-GroupSnapshotsTest-1654961336 None] Group tempest-GroupSnapshotsTest-Group-505315597: creating
Jun 01 01:50:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6dbb8153-a5ee-407d-b03a-a57fd2afccb7 tempest-GroupSnapshotsTest-1654961336 None] Group tempest-GroupSnapshotsTest-Group-505315597: created successfully
Jun 01 01:50:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6dbb8153-a5ee-407d-b03a-a57fd2afccb7 tempest-GroupSnapshotsTest-1654961336 None] Create group completed successfully.
Jun 01 01:50:30 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38" returned: 0 in 6.088s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[16623b74-f076-40fe-988d-f1a7fadd950f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:30 devstack sudo[95870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de
Jun 01 01:50:30 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:31 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de" returned: 0 in 0.924s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:31 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:50:31 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Converted 1024.00 MB image at 168.18 MB/s
Jun 01 01:50:31 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 is being set with open permissions: ugo+rw
Jun 01 01:50:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:31 devstack sudo[95875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38
Jun 01 01:50:31 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (b19d3aff-ef39-47b0-aec1-699a3f7bf954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4d14e7-0014-4e75-9fc0-802a1226abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4d14e7-0014-4e75-9fc0-802a1226abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-989391381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=509d215d-8512-45ee-a778-95da993e071f,host='devstack@QuobyteHD#QuobyteHD',id=783b540e-89a8-41c0-a3a0-0e511b33e31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:32Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1433490c-02b2-402c-978d-cd6f57b0cfd6),volume_type_id=1433490c-02b2-402c-978d-cd6f57b0cfd6)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830d8336-8eb1-4551-b0a5-81a18e4cd39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830d8336-8eb1-4551-b0a5-81a18e4cd39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc1e13a-ff5c-473e-841a-38a2c4cdd6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc1e13a-ff5c-473e-841a-38a2c4cdd6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783b540e-89a8-41c0-a3a0-0e511b33e31a', 'volume_name': 'volume-783b540e-89a8-41c0-a3a0-0e511b33e31a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a635726-cc3a-478f-887c-cd13cde3e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a635726-cc3a-478f-887c-cd13cde3e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdd8969-5270-4e56-91b6-b2da40bd51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Volume 783b540e-89a8-41c0-a3a0-0e511b33e31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783b540e-89a8-41c0-a3a0-0e511b33e31a', 'volume_size': 1}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:32 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fd8d2d65-c17e-4098-a84d-644c6767cc38" released by "_copy_volume_from_snapshot" :: held 9.462s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-a44ca52c-4739-4bb3-aa87-60e9aba3ee17-fd8d2d65-c17e-4098-a84d-644c6767cc38" released by "_create_volume_from_snapshot" :: held 9.534s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.577s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.087s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1086780710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc3ce35-75e5-4675-b52e-b4661877e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273d553a114a4d3ab9cbd5b8935bb8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:23Z,use_quota=True,user_id='4db752b1497e4cc792d1b3fe2e4df61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Creating volume edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:32 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c 1073741824
Jun 01 01:50:32 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74acc85-f380-4451-abe4-e869eb70de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8d2d65-c17e-4098-a84d-644c6767cc38', 'volume_size': 2, 'snapshot_id': 'a44ca52c-4739-4bb3-aa87-60e9aba3ee17'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca9effe-4e2c-4e94-8c1d-feb0ee0baf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Volume volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 (fd8d2d65-c17e-4098-a84d-644c6767cc38): created successfully
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca9effe-4e2c-4e94-8c1d-feb0ee0baf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (6626981b-b839-4bd5-b246-b2d2b8ab8702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7a86dc65-dcb8-4d29-9c55-6a7ba924de5b tempest-VolumesSnapshotTestJSON-963163312 None] Created volume successfully.
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-fd8d2d65-c17e-4098-a84d-644c6767cc38-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-fd8d2d65-c17e-4098-a84d-644c6767cc38-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-fd8d2d65-c17e-4098-a84d-644c6767cc38" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fd8d2d65-c17e-4098-a84d-644c6767cc38" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7d95b-9dad-445d-ada0-1c12f409f421]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:33 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38
Jun 01 01:50:33 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:33 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c 1073741824" returned: 0 in 0.962s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:33 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c
Jun 01 01:50:33 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:33 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:33 devstack sudo[95892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38
Jun 01 01:50:33 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:34 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c" returned: 0 in 0.623s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=509d215d-8512-45ee-a778-95da993e071f,created_at=2026-05-31T23:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-989391381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=509d215d-8512-45ee-a778-95da993e071f,host='devstack@QuobyteHD#QuobyteHD',id=783b540e-89a8-41c0-a3a0-0e511b33e31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:32Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1433490c-02b2-402c-978d-cd6f57b0cfd6),volume_type_id=1433490c-02b2-402c-978d-cd6f57b0cfd6)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Creating volume 783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:34 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a 1073741824
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ecc534-a81b-46a4-8295-890b96f31b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc3ce35-75e5-4675-b52e-b4661877e97c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:34 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b4e33b-9020-40eb-a9e1-15ff2e536c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Volume volume-edc3ce35-75e5-4675-b52e-b4661877e97c (edc3ce35-75e5-4675-b52e-b4661877e97c): created successfully
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b4e33b-9020-40eb-a9e1-15ff2e536c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Flow 'volume_create_manager' (8f2ede43-3ff3-43cc-acf9-4b9dd21eb220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-770b1e3f-8b6b-4fd2-8afb-bb667970e53b tempest-SnapshotMetadataTestJSON-560091720 None] Created volume successfully.
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:34 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fd8d2d65-c17e-4098-a84d-644c6767cc38" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fd8d2d65-c17e-4098-a84d-644c6767cc38" released by "delete_volume" :: held 1.623s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['8b4a3f9d-1f1d-40df-a23f-2dee4eb8b3c6', 'adc2e730-b0e2-46ad-88c2-9a7e6ec7acd5', '7708b09b-7578-4dda-947d-ccc48fde2c04', 'f2475033-909c-4c3e-9617-55eeb17871c7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:34 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:34 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:35 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a 1073741824" returned: 0 in 1.009s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:35 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a
Jun 01 01:50:35 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-a44ca52c-4739-4bb3-aa87-60e9aba3ee17-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-a44ca52c-4739-4bb3-aa87-60e9aba3ee17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-0e9b3531-0627-438f-9341-6344d878c0de" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-0e9b3531-0627-438f-9341-6344d878c0de" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-a44ca52c-4739-4bb3-aa87-60e9aba3ee17" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-a44ca52c-4739-4bb3-aa87-60e9aba3ee17" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Deleting offline snapshot a44ca52c-4739-4bb3-aa87-60e9aba3ee17 of volume 0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] snapshot_file for this snap is: volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:50:35 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[92373c63-e3fe-49e1-bd62-0ab762183ec7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Deleted volume successfully.
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed5f80d5-4063-4c9b-add3-dc936367ce7e tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-fd8d2d65-c17e-4098-a84d-644c6767cc38-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:35 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17
Jun 01 01:50:35 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:35 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.197s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Creating offline snapshot b1055284-e51c-4862-8b5f-46f22cc2d624 of volume edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdd8969-5270-4e56-91b6-b2da40bd51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783b540e-89a8-41c0-a3a0-0e511b33e31a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66bbc25-033e-4863-88a5-57bc01df27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cde45c-bae7-48f1-aa0c-c64267126e6e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Volume volume-783b540e-89a8-41c0-a3a0-0e511b33e31a (783b540e-89a8-41c0-a3a0-0e511b33e31a): created successfully
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66bbc25-033e-4863-88a5-57bc01df27b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (b19d3aff-ef39-47b0-aec1-699a3f7bf954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cecd0614-35fe-4123-8c86-1cc19e51670e tempest-GroupSnapshotsTest-1654961336 None] Created volume successfully.
Jun 01 01:50:35 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c
Jun 01 01:50:35 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:36 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Flow 'volume_create_manager' (34bb98ca-0013-4728-ac72-ddcbf57f606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483807e9-9232-404b-8f07-63cfb9d40e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17" returned: 0 in 0.833s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e9b3531-0627-438f-9341-6344d878c0de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483807e9-9232-404b-8f07-63cfb9d40e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1896075351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0251898-d126-48d6-aad7-98a129d8ae80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9ca61a08544114a24ccee7ab3aa124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:36Z,use_quota=True,user_id='443df9929a984858883c12c46f0deaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56da98d9-f0d9-48e8-8fa1-63b435f42c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56da98d9-f0d9-48e8-8fa1-63b435f42c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35152e10-9a49-4eaf-882a-c12d1373923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35152e10-9a49-4eaf-882a-c12d1373923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0251898-d126-48d6-aad7-98a129d8ae80', 'volume_name': 'volume-a0251898-d126-48d6-aad7-98a129d8ae80', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c84ad3-906f-49ce-bfaa-bbc4a843c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c84ad3-906f-49ce-bfaa-bbc4a843c228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01ac1e4-9683-4b66-bd3f-47724415b60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Volume a0251898-d126-48d6-aad7-98a129d8ae80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0251898-d126-48d6-aad7-98a129d8ae80', 'volume_size': 1}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cfa568-f763-42ed-8791-3b048f80b6d7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:36 devstack sudo[95915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de
Jun 01 01:50:36 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:36 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c" returned: 0 in 0.776s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:36 devstack sudo[95920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 1G
Jun 01 01:50:36 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (f28f7501-409c-4b81-aebb-6f21b595a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50e122d-b8e3-441b-aa2f-ac5a5ce15f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50e122d-b8e3-441b-aa2f-ac5a5ce15f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1651705459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=509d215d-8512-45ee-a778-95da993e071f,host='devstack@QuobyteHD#QuobyteHD',id=f7c708fd-876f-4d3f-ad55-56fdfd4c43dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:37Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1433490c-02b2-402c-978d-cd6f57b0cfd6),volume_type_id=1433490c-02b2-402c-978d-cd6f57b0cfd6)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd09b37-0932-4d00-a66d-4fca014f9aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd09b37-0932-4d00-a66d-4fca014f9aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3010f84-11b1-451a-9a39-e093095acdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3010f84-11b1-451a-9a39-e093095acdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c708fd-876f-4d3f-ad55-56fdfd4c43dd', 'volume_name': 'volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f616f68-a38d-48ca-a764-eeacad3f7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f616f68-a38d-48ca-a764-eeacad3f7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752d1c5c-b994-4a75-93aa-58c44dfdb235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Volume f7c708fd-876f-4d3f-ad55-56fdfd4c43dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd', 'volume_size': 1}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:37 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:37 devstack sudo[95927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17
Jun 01 01:50:37 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:37 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 1G" returned: 0 in 0.856s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc3ce35-75e5-4675-b52e-b4661877e97c -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:37 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc3ce35-75e5-4675-b52e-b4661877e97c -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624
Jun 01 01:50:37 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:37 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:37 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17
Jun 01 01:50:37 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:38 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc3ce35-75e5-4675-b52e-b4661877e97c -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624" returned: 0 in 0.683s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:38 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 is being set with open permissions: ugo+rw
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:38 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624
Jun 01 01:50:38 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:38 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de.a44ca52c-4739-4bb3-aa87-60e9aba3ee17" returned: 0 in 0.608s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-a44ca52c-4739-4bb3-aa87-60e9aba3ee17" released by "_delete_snapshot" :: held 3.076s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-0e9b3531-0627-438f-9341-6344d878c0de" released by "delete_snapshot" :: held 3.105s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['fbbd742b-a181-4374-a3f8-f7bef8a5a8c1', '8193404b-b510-4438-9972-37a8f8be987c', '91267f62-ad06-4276-b00b-4a68bb6020c0', 'c2bda839-1169-4301-bb5e-365fd36a6c5c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Delete snapshot completed successfully.
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-022c44be-07f6-42ec-a480-1d522e1c94f9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-a44ca52c-4739-4bb3-aa87-60e9aba3ee17-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:38 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:38 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.info
Jun 01 01:50:38 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:39 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.info" returned: 0 in 0.597s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:39 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.info is being set with open permissions: ugo+rw
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:39 devstack sudo[95950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.info
Jun 01 01:50:39 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-0e9b3531-0627-438f-9341-6344d878c0de-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-0e9b3531-0627-438f-9341-6344d878c0de-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-0e9b3531-0627-438f-9341-6344d878c0de" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-0e9b3531-0627-438f-9341-6344d878c0de" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23cc069-c873-4faa-b210-7100b596b5ec]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:39 devstack sudo[95952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de
Jun 01 01:50:39 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:40 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.info" returned: 0 in 0.602s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.248s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.641s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1896075351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0251898-d126-48d6-aad7-98a129d8ae80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9ca61a08544114a24ccee7ab3aa124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:36Z,use_quota=True,user_id='443df9929a984858883c12c46f0deaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Creating volume a0251898-d126-48d6-aad7-98a129d8ae80 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:40 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:40 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80 1073741824
Jun 01 01:50:40 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d471857b-7674-44fe-abe1-61e7044db502 tempest-SnapshotMetadataTestJSON-560091720 None] Create snapshot completed successfully
Jun 01 01:50:40 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:40 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de
Jun 01 01:50:40 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:40 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80 1073741824" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:40 devstack sudo[95966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80
Jun 01 01:50:40 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:41 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0e9b3531-0627-438f-9341-6344d878c0de" returned: 0 in 0.658s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-0e9b3531-0627-438f-9341-6344d878c0de" released by "delete_volume" :: held 1.431s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['77f3354b-dae5-45eb-8fbd-9694c1c009db', 'efd0d006-4967-4a13-95b0-a09f6fb8c3fa', '3eeba2bb-92b0-4862-a8c1-b6518152c1d5', '42cd5f46-3772-4eba-866a-04d3a0331701'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:41 devstack sudo[95969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:41 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:41 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80" returned: 0 in 0.671s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.407s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=509d215d-8512-45ee-a778-95da993e071f,created_at=2026-05-31T23:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1651705459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=509d215d-8512-45ee-a778-95da993e071f,host='devstack@QuobyteHD#QuobyteHD',id=f7c708fd-876f-4d3f-ad55-56fdfd4c43dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:37Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1433490c-02b2-402c-978d-cd6f57b0cfd6),volume_type_id=1433490c-02b2-402c-978d-cd6f57b0cfd6)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Creating volume f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:41 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "cinder-b1055284-e51c-4862-8b5f-46f22cc2d624-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:41 devstack sudo[95972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd 1073741824
Jun 01 01:50:41 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01ac1e4-9683-4b66-bd3f-47724415b60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0251898-d126-48d6-aad7-98a129d8ae80', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ff90a5-8e1e-477d-b14b-618be93961d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Volume volume-a0251898-d126-48d6-aad7-98a129d8ae80 (a0251898-d126-48d6-aad7-98a129d8ae80): created successfully
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ff90a5-8e1e-477d-b14b-618be93961d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Flow 'volume_create_manager' (34bb98ca-0013-4728-ac72-ddcbf57f606c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-b1055284-e51c-4862-8b5f-46f22cc2d624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "cinder-quobyte-edc3ce35-75e5-4675-b52e-b4661877e97c" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b018bbda-1cf4-4c31-a1e3-a495832dc38e tempest-VolumesTransfersV357Test-320481680 None] Created volume successfully.
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-quobyte-edc3ce35-75e5-4675-b52e-b4661877e97c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "cinder-quobyte-b1055284-e51c-4862-8b5f-46f22cc2d624" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-quobyte-b1055284-e51c-4862-8b5f-46f22cc2d624" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Deleting offline snapshot b1055284-e51c-4862-8b5f-46f22cc2d624 of volume edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] snapshot_file for this snap is: volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b455e54-8c44-4ae4-87c7-f6b87da36467]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:41 devstack sudo[95974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624
Jun 01 01:50:41 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:42 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.660s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Deleted volume successfully.
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f36989b7-0a1e-4bf3-a364-267270cd0ef6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-0e9b3531-0627-438f-9341-6344d878c0de-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (289472c3-b9a5-4a28-8d2f-b34f68431506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161a81ab-b880-4fb2-b88a-e991163d398a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161a81ab-b880-4fb2-b88a-e991163d398a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1056849139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f165eba2-26fa-4d2d-9113-1f587d57a0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:42Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:42 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13009026-303b-4c28-a9ec-5bf10b6475b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13009026-303b-4c28-a9ec-5bf10b6475b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee62ecfe-dc4a-4fc8-b00d-1c66ee22e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee62ecfe-dc4a-4fc8-b00d-1c66ee22e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f165eba2-26fa-4d2d-9113-1f587d57a0ca', 'volume_name': 'volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2145f0f0-b978-496a-a1a7-56c0abd143ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2145f0f0-b978-496a-a1a7-56c0abd143ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826ad6bb-0cc6-42f9-9c9c-8318e862d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:42 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Volume f165eba2-26fa-4d2d-9113-1f587d57a0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca', 'volume_size': 1}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd 1073741824" returned: 0 in 0.933s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:42 devstack sudo[95985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd
Jun 01 01:50:42 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:42 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624" returned: 0 in 0.821s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edc3ce35-75e5-4675-b52e-b4661877e97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c768b-a46a-47d3-b933-25a0e39b2e12]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:42 devstack sudo[95987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c
Jun 01 01:50:42 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:43 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1056849139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f165eba2-26fa-4d2d-9113-1f587d57a0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:42Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Creating volume f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:43 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752d1c5c-b994-4a75-93aa-58c44dfdb235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:43 devstack sudo[95992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca 1073741824
Jun 01 01:50:43 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2ce21-4aa2-4e80-ad0e-3b340db3a7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Volume volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd (f7c708fd-876f-4d3f-ad55-56fdfd4c43dd): created successfully
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2ce21-4aa2-4e80-ad0e-3b340db3a7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (f28f7501-409c-4b81-aebb-6f21b595a723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5104ea80-eeb3-4b72-9d16-d407650b06f7 tempest-VolumesTransfersV357Test-1701620592 None] Transfer volume completed successfully.
Jun 01 01:50:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2375febd-f195-48b7-b23e-44fd0d6ef6b4 tempest-GroupSnapshotsTest-1654961336 None] Created volume successfully.
Jun 01 01:50:43 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c" returned: 0 in 0.766s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:43 devstack sudo[95995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624
Jun 01 01:50:43 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d3be24c9-c343-4ef9-80b2-3546c8735db3 tempest-GroupSnapshotsTest-1654961336 None] Update group completed successfully.
Jun 01 01:50:44 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca 1073741824" returned: 0 in 0.892s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:44 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624" returned: 0 in 0.778s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:44 devstack sudo[96005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca
Jun 01 01:50:44 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:44 devstack sudo[96006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624
Jun 01 01:50:44 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Acquiring lock "cinder-a0251898-d126-48d6-aad7-98a129d8ae80-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-a0251898-d126-48d6-aad7-98a129d8ae80-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Acquiring lock "cinder-quobyte-a0251898-d126-48d6-aad7-98a129d8ae80" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-quobyte-a0251898-d126-48d6-aad7-98a129d8ae80" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51ffee9-1d79-4205-8e5d-dead19b913d8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:44 devstack sudo[96009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80
Jun 01 01:50:44 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:44 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca" returned: 0 in 0.615s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:44 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c.b1055284-e51c-4862-8b5f-46f22cc2d624" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826ad6bb-0cc6-42f9-9c9c-8318e862d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7380d8d-9443-423c-ba4a-dfce5cbec4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-quobyte-b1055284-e51c-4862-8b5f-46f22cc2d624" released by "_delete_snapshot" :: held 3.128s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Volume volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca (f165eba2-26fa-4d2d-9113-1f587d57a0ca): created successfully
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7380d8d-9443-423c-ba4a-dfce5cbec4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (289472c3-b9a5-4a28-8d2f-b34f68431506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-quobyte-edc3ce35-75e5-4675-b52e-b4661877e97c" released by "delete_snapshot" :: held 3.173s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6299fabe-7cb2-45e1-a76f-469c9a741cad tempest-VolumesSnapshotTestJSON-963163312 None] Created volume successfully.
Jun 01 01:50:44 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Created reservations ['76baff71-842b-4b8a-9bf4-97386e1f69bf', 'f9a62715-d6a1-48d2-be2e-8eefc0a9dfa8', '4c699d97-f881-4457-9a85-2b296b6d96fd', '218dbe33-5230-4022-89ed-a582faacf46c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Delete snapshot completed successfully.
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-447c5aa1-cb6c-4bcb-a6fe-74be7332a4fa tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-b1055284-e51c-4862-8b5f-46f22cc2d624-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e9c67d3f-5da3-4894-bec8-b78aac98968b tempest-GroupSnapshotsTest-1654961336 None] Update group completed successfully.
Jun 01 01:50:45 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:45 devstack sudo[96016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80
Jun 01 01:50:45 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:45 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a0251898-d126-48d6-aad7-98a129d8ae80" returned: 0 in 0.617s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-quobyte-a0251898-d126-48d6-aad7-98a129d8ae80" released by "delete_volume" :: held 1.440s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Creating offline snapshot 047742cb-9b67-4ca1-a2d9-af2cf115bef1 of volume f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9df625a-7d6c-4738-a0e8-49a64a6adcec]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Created reservations ['8cab057e-03c7-4bb9-9781-7067b8fbcab5', '8d57c5e3-953a-4d46-add2-4c8469d8a031', '2161f1d4-c240-4348-8652-43876c0b9aa0', '9ba64a45-ddef-4d6f-9c98-80802ce5f5f7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:46 devstack sudo[96019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca
Jun 01 01:50:46 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:46 devstack sudo[96020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:46 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "cinder-edc3ce35-75e5-4675-b52e-b4661877e97c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-edc3ce35-75e5-4675-b52e-b4661877e97c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "cinder-quobyte-edc3ce35-75e5-4675-b52e-b4661877e97c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-quobyte-edc3ce35-75e5-4675-b52e-b4661877e97c" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[94422982-b09f-4be0-aa4a-32bb51120b78]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:46 devstack sudo[96023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c
Jun 01 01:50:46 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d5b028a9-6acf-4d82-bc99-890f420edd85 tempest-GroupSnapshotsTest-1654961336 None] Update group completed successfully.
Jun 01 01:50:46 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.674s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Deleted volume successfully.
Jun 01 01:50:46 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c591f711-22b2-4fcb-a7a8-791cb2ab20d7 tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-a0251898-d126-48d6-aad7-98a129d8ae80-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:46 devstack sudo[96030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 1G
Jun 01 01:50:46 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:47 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Flow 'volume_create_manager' (3f60d0e1-5b6a-4684-b0e3-bbe15a51225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daad20af-4fdb-4a90-bcf0-27b5b9fab884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:47 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c
Jun 01 01:50:47 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daad20af-4fdb-4a90-bcf0-27b5b9fab884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-502241417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431703a5-ac5a-4285-aa8c-8886525873a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9ca61a08544114a24ccee7ab3aa124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:47Z,use_quota=True,user_id='443df9929a984858883c12c46f0deaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0a096b-bd1a-48b3-8291-d136537f34c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0a096b-bd1a-48b3-8291-d136537f34c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3223eaa2-ab39-4ebe-87b3-f3d5c12649e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3223eaa2-ab39-4ebe-87b3-f3d5c12649e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431703a5-ac5a-4285-aa8c-8886525873a9', 'volume_name': 'volume-431703a5-ac5a-4285-aa8c-8886525873a9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc5c4b7-3a39-414c-ae27-3d707c1faf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc5c4b7-3a39-414c-ae27-3d707c1faf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53d6d18-2b80-4259-b35e-471e323c592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Volume 431703a5-ac5a-4285-aa8c-8886525873a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431703a5-ac5a-4285-aa8c-8886525873a9', 'volume_size': 1}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:47 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 1G" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:47 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1
Jun 01 01:50:47 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-251b6ee0-22aa-419e-9f2e-3aff2cda4c43 tempest-GroupSnapshotsTest-1654961336 None] Update group completed successfully.
Jun 01 01:50:47 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edc3ce35-75e5-4675-b52e-b4661877e97c" returned: 0 in 0.697s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-quobyte-edc3ce35-75e5-4675-b52e-b4661877e97c" released by "delete_volume" :: held 1.663s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Created reservations ['c93774b3-4e98-41d5-81e8-41ca0ac2348f', 'aa791b63-8061-40af-8eeb-23bb0c8d5cd5', '4f5ca25f-a44c-4b6b-9e92-42aea8d98ef0', '1c31849e-9632-4df8-9617-faf32cc93e74'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:47 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:47 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:48 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:48 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 is being set with open permissions: ugo+rw
Jun 01 01:50:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:48 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1
Jun 01 01:50:48 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:48 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.622s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:48 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Deleted volume successfully.
Jun 01 01:50:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7765b723-cab0-4e68-a00a-3ffafb51f0ae tempest-SnapshotMetadataTestJSON-560091720 None] Lock "cinder-edc3ce35-75e5-4675-b52e-b4661877e97c-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:48 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1" returned: 0 in 0.590s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:48 devstack sudo[96088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.info
Jun 01 01:50:48 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] GroupSnapshot 246ccaff-0072-455c-820a-f9d5d790e596: creating.
Jun 01 01:50:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Group snapshot 246ccaff-0072-455c-820a-f9d5d790e596: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 01 01:50:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:49 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.info" returned: 0 in 0.641s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:49 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.info is being set with open permissions: ugo+rw
Jun 01 01:50:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:49 devstack sudo[96091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.info
Jun 01 01:50:49 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:50 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.info" returned: 0 in 0.660s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.964s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-502241417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431703a5-ac5a-4285-aa8c-8886525873a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9ca61a08544114a24ccee7ab3aa124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:47Z,use_quota=True,user_id='443df9929a984858883c12c46f0deaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Creating volume 431703a5-ac5a-4285-aa8c-8886525873a9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:50:50 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:50 devstack sudo[96095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9 1073741824
Jun 01 01:50:50 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1a9f7209-f8e7-4da4-89f7-faa6849ec87c tempest-VolumesSnapshotTestJSON-963163312 None] Create snapshot completed successfully
Jun 01 01:50:50 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9 1073741824" returned: 0 in 0.811s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:51 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9
Jun 01 01:50:51 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (774b67c7-56df-4834-96bc-766c2aa91648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af99416-bc1f-4898-b200-5f62cf2f0ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af99416-bc1f-4898-b200-5f62cf2f0ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-162872579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b53c856329914f8b9cc093181b678620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=047742cb-9b67-4ca1-a2d9-af2cf115bef1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:52Z,use_quota=True,user_id='65829d5ebccd4fc49e99d70822b12f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93ae0d1-9439-46ef-b093-f95982f873e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93ae0d1-9439-46ef-b093-f95982f873e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c826b06-21df-4a07-8efd-36e19cd2eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:51 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c826b06-21df-4a07-8efd-36e19cd2eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3', 'volume_name': 'volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3', 'volume_size': 1, 'snapshot_id': '047742cb-9b67-4ca1-a2d9-af2cf115bef1'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa3cfa5-1142-48c7-b8ed-75e2d461d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa3cfa5-1142-48c7-b8ed-75e2d461d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278451d8-dffd-496d-8db1-f67165897ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Volume fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3', 'volume_size': 1, 'snapshot_id': '047742cb-9b67-4ca1-a2d9-af2cf115bef1'}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9" returned: 0 in 0.740s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.700s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Creating offline snapshot 24b1a2f3-39de-4385-9ac9-c7d6730f0b6b of volume 783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53d6d18-2b80-4259-b35e-471e323c592d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431703a5-ac5a-4285-aa8c-8886525873a9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12a20a3-5306-4aad-8d3d-ccae175f0edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7bd8fb-6f7e-4c4d-94ec-69fd1f65b225]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Volume volume-431703a5-ac5a-4285-aa8c-8886525873a9 (431703a5-ac5a-4285-aa8c-8886525873a9): created successfully
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12a20a3-5306-4aad-8d3d-ccae175f0edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Flow 'volume_create_manager' (3f60d0e1-5b6a-4684-b0e3-bbe15a51225c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f142dd2c-acd6-4201-b0d8-4c37643d4e56 tempest-VolumesTransfersV357Test-320481680 None] Created volume successfully.
Jun 01 01:50:51 devstack sudo[96105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a
Jun 01 01:50:51 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:52 devstack sudo[96107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:52 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:52 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a" returned: 0 in 0.869s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:52 devstack sudo[96113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b 1G
Jun 01 01:50:52 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Flow 'volume_create_manager' (e174547c-0153-4ffd-aa66-e55055319dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6b85be-a09a-4cef-85b2-ffb87014fb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Acquiring lock "cinder-431703a5-ac5a-4285-aa8c-8886525873a9-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6b85be-a09a-4cef-85b2-ffb87014fb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1615952671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a2c7a4-6708-408e-b74b-e7c165ebadf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c641823a33e4d0681e7cbcd8279bb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:53Z,use_quota=True,user_id='852ab78e067543c7baa5986c92b92665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5565c14e-3830-4d90-902e-f318464a3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5565c14e-3830-4d90-902e-f318464a3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03fa97f-ae0b-49bc-bf39-e27a43d61e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03fa97f-ae0b-49bc-bf39-e27a43d61e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a2c7a4-6708-408e-b74b-e7c165ebadf6', 'volume_name': 'volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23279dd-bca9-4979-a9fe-76d51d34fd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23279dd-bca9-4979-a9fe-76d51d34fd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0e85ce-6c64-42e2-80c6-30fe9d91abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:50:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Volume 12a2c7a4-6708-408e-b74b-e7c165ebadf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6', 'volume_size': 1}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-431703a5-ac5a-4285-aa8c-8886525873a9-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Acquiring lock "cinder-quobyte-431703a5-ac5a-4285-aa8c-8886525873a9" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-quobyte-431703a5-ac5a-4285-aa8c-8886525873a9" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c98b63f-e445-4662-929c-a3c0d98ce034]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:53 devstack sudo[96115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9
Jun 01 01:50:53 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:53 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:50:53 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b 1G" returned: 0 in 0.775s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783b540e-89a8-41c0-a3a0-0e511b33e31a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:53 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783b540e-89a8-41c0-a3a0-0e511b33e31a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b
Jun 01 01:50:53 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:53 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:53 devstack sudo[96130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9
Jun 01 01:50:53 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:54 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783b540e-89a8-41c0-a3a0-0e511b33e31a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" returned: 0 in 0.672s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:54 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:54 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b
Jun 01 01:50:54 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:54 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-431703a5-ac5a-4285-aa8c-8886525873a9" returned: 0 in 0.600s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-quobyte-431703a5-ac5a-4285-aa8c-8886525873a9" released by "delete_volume" :: held 1.389s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Created reservations ['5c22b184-c6b9-42f5-be47-7067f0293f66', '63f9890b-4b51-42b1-9b74-938539edd815', '72da4a7c-6115-4ced-8972-6539c2bc0af4', 'ba19bc90-e22b-4ccb-a4f7-5a44a557231b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:54 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:50:54 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:54 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" returned: 0 in 0.632s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:54 devstack sudo[96144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.info
Jun 01 01:50:54 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:54 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.593s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:50:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Deleted volume successfully.
Jun 01 01:50:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ce5d1633-f305-4ed7-8d6a-4d52bb1d58ef tempest-VolumesTransfersV357Test-176960145 None] Lock "cinder-431703a5-ac5a-4285-aa8c-8886525873a9-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:50:55 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.info" returned: 0 in 0.631s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:55 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:50:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:55 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.info
Jun 01 01:50:55 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:55 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.info" returned: 0 in 0.585s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:50:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:50:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:50:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Creating offline snapshot 674c9658-bb51-4253-b28a-7e4457c29ca2 of volume f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:50:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eee18b6-f07b-45dd-9255-9855477a9607]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:50:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:56 devstack sudo[96153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd
Jun 01 01:50:56 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:56 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" returned: 0 in 0.740s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:56 devstack sudo[96158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 1G
Jun 01 01:50:56 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:57 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 1G" returned: 0 in 0.807s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:57 devstack sudo[96163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2
Jun 01 01:50:57 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:58 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2" returned: 0 in 0.691s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:58 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:50:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:58 devstack sudo[96168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2
Jun 01 01:50:58 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:58 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:58 devstack sudo[96171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.info
Jun 01 01:50:58 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:50:59 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root
Jun 01 01:50:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.info" returned: 0 in 0.619s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:50:59 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:50:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:50:59 devstack sudo[96174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.info
Jun 01 01:50:59 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:00 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.info" returned: 0 in 0.606s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.199s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.385s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1615952671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a2c7a4-6708-408e-b74b-e7c165ebadf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c641823a33e4d0681e7cbcd8279bb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:50:53Z,use_quota=True,user_id='852ab78e067543c7baa5986c92b92665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Creating volume 12a2c7a4-6708-408e-b74b-e7c165ebadf6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:00 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:00 devstack sudo[96177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6 1073741824
Jun 01 01:51:00 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0110af68-d421-4224-bbbd-7e3036978542 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 246ccaff-0072-455c-820a-f9d5d790e596: created successfully
Jun 01 01:51:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 246ccaff-0072-455c-820a-f9d5d790e596: deleting
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 246ccaff-0072-455c-820a-f9d5d790e596: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-783b540e-89a8-41c0-a3a0-0e511b33e31a" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-783b540e-89a8-41c0-a3a0-0e511b33e31a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Deleting offline snapshot 24b1a2f3-39de-4385-9ac9-c7d6730f0b6b of volume 783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] snapshot_file for this snap is: volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8f092-b427-4300-985d-eb57d203902d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:01 devstack sudo[96183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b
Jun 01 01:51:01 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:01 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6 1073741824" returned: 0 in 0.994s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:01 devstack sudo[96187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6
Jun 01 01:51:01 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:01 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" returned: 0 in 0.773s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-783b540e-89a8-41c0-a3a0-0e511b33e31a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565bdaf-b045-4f73-a22c-90e1edfc6de0]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:01 devstack sudo[96192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a
Jun 01 01:51:01 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:01 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.167s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-047742cb-9b67-4ca1-a2d9-af2cf115bef1-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0e85ce-6c64-42e2-80c6-30fe9d91abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9b4cf8-5851-438f-a316-4cd481c96810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-047742cb-9b67-4ca1-a2d9-af2cf115bef1-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Creating volume fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 from snapshot 047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Volume volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6 (12a2c7a4-6708-408e-b74b-e7c165ebadf6): created successfully
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9b4cf8-5851-438f-a316-4cd481c96810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Flow 'volume_create_manager' (e174547c-0153-4ffd-aa66-e55055319dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] snapshot: 047742cb-9b67-4ca1-a2d9-af2cf115bef1, volume: fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:51:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e5b8fa5c-7a2a-4c4e-9eb1-db9a95b8df98 tempest-VolumesTransfersV355Test-1691239658 None] Created volume successfully.
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da7c72c-6c27-4abf-91c2-6f441b27f573]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:02 devstack sudo[96195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1
Jun 01 01:51:02 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:02 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a" returned: 0 in 0.901s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:02 devstack sudo[96200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b
Jun 01 01:51:02 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:03 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4c8c14-73f7-4ecb-808e-ee9651161d44]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-827e990b-4ed7-489b-874f-ebbf935c13fb tempest-VolumesTransfersV355Test-1983566880 None] Transfer volume completed successfully.
Jun 01 01:51:03 devstack sudo[96207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca
Jun 01 01:51:03 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:03 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" returned: 0 in 0.851s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:03 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b
Jun 01 01:51:03 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:03 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:51:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:03 devstack sudo[96217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3
Jun 01 01:51:03 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:04 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a.24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-24b1a2f3-39de-4385-9ac9-c7d6730f0b6b" released by "_delete_snapshot" :: held 3.375s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-783b540e-89a8-41c0-a3a0-0e511b33e31a" released by "delete_snapshot" :: held 3.414s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Acquiring lock "cinder-12a2c7a4-6708-408e-b74b-e7c165ebadf6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-674c9658-bb51-4253-b28a-7e4457c29ca2" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-12a2c7a4-6708-408e-b74b-e7c165ebadf6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-674c9658-bb51-4253-b28a-7e4457c29ca2" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Deleting offline snapshot 674c9658-bb51-4253-b28a-7e4457c29ca2 of volume f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] snapshot_file for this snap is: volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7848e3db-be5c-4ba6-9e34-159f6e5b6240]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Acquiring lock "cinder-quobyte-12a2c7a4-6708-408e-b74b-e7c165ebadf6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-quobyte-12a2c7a4-6708-408e-b74b-e7c165ebadf6" acquired by "delete_volume" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7050d-28f1-4c53-a117-7c2865089502]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:04 devstack sudo[96220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2
Jun 01 01:51:04 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:04 devstack sudo[96224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6
Jun 01 01:51:04 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:06 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2" returned: 0 in 1.950s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:51:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[97db69a9-8d28-48fe-a10e-31562f72633c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:06 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6" returned: 0 in 2.100s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:06 devstack sudo[96241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6
Jun 01 01:51:06 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:06 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd
Jun 01 01:51:06 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:08 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-12a2c7a4-6708-408e-b74b-e7c165ebadf6" returned: 0 in 2.085s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-quobyte-12a2c7a4-6708-408e-b74b-e7c165ebadf6" released by "delete_volume" :: held 4.276s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:08 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" returned: 0 in 2.416s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:08 devstack sudo[96249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2
Jun 01 01:51:08 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Created reservations ['7b573634-01fe-4b33-9a6d-f728fdea6dbf', '117ea5e6-90c9-47fd-ab1c-bf27a865d65b', '31e68233-4ade-40e9-8db3-4d9d7a80fa74', '68040694-c774-4c5e-9496-ed466f67a7be'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:09 devstack sudo[96251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:09 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:10 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" returned: 0 in 6.724s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c5aa4c-6716-4921-ad63-b4be4bb2dc1f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:10 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.316s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Deleted volume successfully.
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3a50c6f4-8967-46af-9c53-86d4488ffa39 tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-12a2c7a4-6708-408e-b74b-e7c165ebadf6-delete_volume" released by "delete_volume" :: held 6.442s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:10 devstack sudo[96256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca
Jun 01 01:51:10 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:10 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2" returned: 0 in 2.098s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:11 devstack sudo[96261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2
Jun 01 01:51:11 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Flow 'volume_create_manager' (265040ac-7fb6-406c-b64d-b38b86e7df4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79709315-6654-4c7d-9901-45fde29156e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79709315-6654-4c7d-9901-45fde29156e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-890638331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b12aca5-90f7-463d-b3d0-8997a67a8069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c641823a33e4d0681e7cbcd8279bb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:11Z,use_quota=True,user_id='852ab78e067543c7baa5986c92b92665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697b7682-e035-4327-8c80-07bc87c5cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697b7682-e035-4327-8c80-07bc87c5cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e369157e-f0e8-4c9a-b22e-a68a8001cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e369157e-f0e8-4c9a-b22e-a68a8001cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b12aca5-90f7-463d-b3d0-8997a67a8069', 'volume_name': 'volume-3b12aca5-90f7-463d-b3d0-8997a67a8069', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bc4923-a551-43a7-97ea-813bd5e35211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bc4923-a551-43a7-97ea-813bd5e35211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a47d81-3605-4e9a-ba6a-132e605268fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Volume 3b12aca5-90f7-463d-b3d0-8997a67a8069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b12aca5-90f7-463d-b3d0-8997a67a8069', 'volume_size': 1}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:11 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd.674c9658-bb51-4253-b28a-7e4457c29ca2" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-674c9658-bb51-4253-b28a-7e4457c29ca2" released by "_delete_snapshot" :: held 7.389s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" released by "delete_snapshot" :: held 7.437s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:11 devstack cinder-volume[86676]: WARNING cinder.quota [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1287839855 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1287839855, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:51:11 devstack cinder-volume[86676]: WARNING cinder.quota [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1287839855 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1287839855, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['ac5545f0-12f8-4d22-a94a-4508c9a7a6d1', '1de7cc53-ace4-455e-9251-59ebb12e92c8', '1b8977d8-a9d8-4d15-95ef-db91c9650c95', 'a46fab1b-d184-4799-b0cd-5e2a5f7410d3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['62cc0a57-c10c-4619-b084-cdc62db78dc2', '5db857ca-3724-4925-894a-1e9b17446d90', 'b4e06baa-0694-45d6-a954-a5ea0f588ea0', '27fc79ab-7922-4df8-a98b-3c0dbbb863cb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:11 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca" returned: 0 in 1.368s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:51:11 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Converted 1024.00 MB image at 152.26 MB/s
Jun 01 01:51:11 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 is being set with open permissions: ugo+rw
Jun 01 01:51:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:12 devstack sudo[96267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3
Jun 01 01:51:12 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-93178866-3bd7-4ed5-878f-6e37321c5aa8 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 246ccaff-0072-455c-820a-f9d5d790e596: deleted successfully
Jun 01 01:51:12 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" released by "_copy_volume_from_snapshot" :: held 10.648s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-047742cb-9b67-4ca1-a2d9-af2cf115bef1-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" released by "_create_volume_from_snapshot" :: held 10.719s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.758s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-890638331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b12aca5-90f7-463d-b3d0-8997a67a8069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c641823a33e4d0681e7cbcd8279bb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:11Z,use_quota=True,user_id='852ab78e067543c7baa5986c92b92665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Creating volume 3b12aca5-90f7-463d-b3d0-8997a67a8069 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:12 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:12 devstack sudo[96270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069 1073741824
Jun 01 01:51:12 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278451d8-dffd-496d-8db1-f67165897ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3', 'volume_size': 1, 'snapshot_id': '047742cb-9b67-4ca1-a2d9-af2cf115bef1'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f195a3-be43-49d6-9d9f-3c1f11e7f869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:12 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Volume volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 (fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3): created successfully
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f195a3-be43-49d6-9d9f-3c1f11e7f869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Flow 'volume_create_manager' (774b67c7-56df-4834-96bc-766c2aa91648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a2c03312-2dd7-407d-a360-5fc4dc5264d5 tempest-VolumesSnapshotTestJSON-963163312 None] Created volume successfully.
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Flow 'volume_create_manager' (431d5f2d-865c-4a14-9b12-248b3b8bd36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1384c9ff-86f7-4019-9b1a-39c2142510cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1384c9ff-86f7-4019-9b1a-39c2142510cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302139206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c05b7a1edd44208c04390f92a844a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:13Z,use_quota=True,user_id='fd8d1166a9054c64b6699dd37c9c2511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18e09d0-6831-427b-b7de-847d2eaed946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18e09d0-6831-427b-b7de-847d2eaed946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee82b1-67e9-4fa3-baa2-53339be3e15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee82b1-67e9-4fa3-baa2-53339be3e15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2', 'volume_name': 'volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40a999c-536b-4f9b-b956-f57a1027708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40a999c-536b-4f9b-b956-f57a1027708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc3f7b1-6a97-4760-ba76-d6e4a0f809c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Volume 7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2', 'volume_size': 1}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-783b540e-89a8-41c0-a3a0-0e511b33e31a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-783b540e-89a8-41c0-a3a0-0e511b33e31a" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f8cd2c-e208-4d2f-9eb2-7e165114a949]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:13 devstack sudo[96275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a
Jun 01 01:51:13 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:13 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069 1073741824" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:13 devstack sudo[96278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069
Jun 01 01:51:13 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbaf6c3-1481-429c-a467-b1f431cdc808]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:14 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a" returned: 0 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:14 devstack sudo[96283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3
Jun 01 01:51:14 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:14 devstack sudo[96284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a
Jun 01 01:51:14 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:14 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302139206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c05b7a1edd44208c04390f92a844a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:13Z,use_quota=True,user_id='fd8d1166a9054c64b6699dd37c9c2511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Creating volume 7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:14 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a47d81-3605-4e9a-ba6a-132e605268fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b12aca5-90f7-463d-b3d0-8997a67a8069', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfbb1c0-3a52-4fe8-813e-3e3e8c1a7393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:14 devstack sudo[96288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 1073741824
Jun 01 01:51:14 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Volume volume-3b12aca5-90f7-463d-b3d0-8997a67a8069 (3b12aca5-90f7-463d-b3d0-8997a67a8069): created successfully
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfbb1c0-3a52-4fe8-813e-3e3e8c1a7393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Flow 'volume_create_manager' (265040ac-7fb6-406c-b64d-b38b86e7df4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bf01927b-ed32-4feb-b658-8749c13d2fec tempest-VolumesTransfersV355Test-1691239658 None] Created volume successfully.
Jun 01 01:51:14 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" returned: 0 in 0.810s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:14 devstack sudo[96294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3
Jun 01 01:51:14 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:14 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-783b540e-89a8-41c0-a3a0-0e511b33e31a" returned: 0 in 0.775s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Acquiring lock "cinder-3b12aca5-90f7-463d-b3d0-8997a67a8069-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-783b540e-89a8-41c0-a3a0-0e511b33e31a" released by "delete_volume" :: held 1.588s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-3b12aca5-90f7-463d-b3d0-8997a67a8069-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d61a4a-2726-48ec-a157-789a49db6f7a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Acquiring lock "cinder-quobyte-3b12aca5-90f7-463d-b3d0-8997a67a8069" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-quobyte-3b12aca5-90f7-463d-b3d0-8997a67a8069" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22aa1a0-291a-41e6-8db1-1f9676366cdf]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:15 devstack sudo[96299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd
Jun 01 01:51:15 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:15 devstack sudo[96301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069
Jun 01 01:51:15 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:15 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 1073741824" returned: 0 in 1.065s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:15 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:51:15 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:15 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" returned: 0 in 0.821s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3" released by "delete_volume" :: held 1.674s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['d07e0fe9-4a12-41be-83aa-8e50c5f6395f', '61264fc6-fb2f-44a4-8cfa-446befe5ae98', '9213cb86-eb84-4f9c-a85b-934031812357', '7eea0465-1726-4365-8e78-ac886d2951d0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:15 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:15 devstack sudo[96311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd
Jun 01 01:51:15 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:15 devstack sudo[96315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:15 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:15 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:15 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069
Jun 01 01:51:15 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:16 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 0.740s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc3f7b1-6a97-4760-ba76-d6e4a0f809c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4135e648-db90-4e99-8487-5e47ed2470c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Volume volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 (7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2): created successfully
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4135e648-db90-4e99-8487-5e47ed2470c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Flow 'volume_create_manager' (431d5f2d-865c-4a14-9b12-248b3b8bd36c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-58211e9a-927f-4724-9e04-ec181697994b tempest-VolumesActionsTest-459592884 None] Created volume successfully.
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-047742cb-9b67-4ca1-a2d9-af2cf115bef1-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-047742cb-9b67-4ca1-a2d9-af2cf115bef1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-f165eba2-26fa-4d2d-9113-1f587d57a0ca" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-f165eba2-26fa-4d2d-9113-1f587d57a0ca" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-047742cb-9b67-4ca1-a2d9-af2cf115bef1" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-047742cb-9b67-4ca1-a2d9-af2cf115bef1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Deleting offline snapshot 047742cb-9b67-4ca1-a2d9-af2cf115bef1 of volume f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] snapshot_file for this snap is: volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca4182-1be3-426f-b25f-1d00afdc7192]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:16 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1
Jun 01 01:51:16 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:16 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" returned: 0 in 0.795s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:16 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.776s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-f7c708fd-876f-4d3f-ad55-56fdfd4c43dd" released by "delete_volume" :: held 1.650s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Deleted volume successfully.
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0eb316e9-71bc-4d3a-9206-92859e0d4636 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-fa32b3ad-81eb-4a0d-b0cd-b4c93ade21f3-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['32dbaad2-d319-465b-870e-b811f4abb532'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:16 devstack cinder-volume[86676]: WARNING cinder.quota [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1287839855 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1287839855, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:51:16 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['2bbb001f-67be-4e72-9c02-3349553f8eb5', '6856a870-172c-45fb-bc2a-ff9305559b81', 'cf09aff9-5fdb-4f24-a716-62109cf65f1b', '941337bc-31eb-4757-bbe8-3c83a799a63c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3b12aca5-90f7-463d-b3d0-8997a67a8069" returned: 0 in 0.886s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-quobyte-3b12aca5-90f7-463d-b3d0-8997a67a8069" released by "delete_volume" :: held 1.776s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Created reservations ['91e7ae43-f2e0-46b7-af3c-dd3ff964b760', 'c7cfe589-874c-4dc3-ac57-2bec4625d194', '89a68234-cac0-4dca-9ff3-9fb680a76571', 'b1cef3d7-eeb6-4bf3-aca8-05e5e2308368'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=166,cinder:UPDATE=182,cinder:INSERT=40,cinder:DELETE=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=184,cinder:SELECT=158,cinder:INSERT=53,cinder:DELETE=14 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['b07cf15f-495f-4a24-be5f-9e67a09c4805', '2c49eace-221f-4bd0-a90e-878e40d75ec2', '64153c88-fc9c-4bd8-94cf-663ee7a5fe38', 'af0c36b0-07f1-44b7-bd07-868e30794862'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:16 devstack sudo[96325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:16 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:17 devstack sudo[96330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:17 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:17 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1" returned: 0 in 1.023s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1681c9-e5a8-461d-8535-61e0f325bb0b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:17 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca
Jun 01 01:51:17 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:18 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:18 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.945s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.098s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b06dbd50-677b-4934-a4a4-4b20c997c40a tempest-GroupSnapshotsTest-1654961336 None] Delete group completed successfully.
Jun 01 01:51:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Deleted volume successfully.
Jun 01 01:51:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aea8e90f-4f39-40c5-8fe6-a832b7d572ca tempest-VolumesTransfersV355Test-514627218 None] Lock "cinder-3b12aca5-90f7-463d-b3d0-8997a67a8069-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2b9a6d46-64ba-465f-96af-0eb99efb31fc tempest-GroupSnapshotsTest-1654961336 None] Group tempest-GroupSnapshotsTest-Group-1197537916: creating
Jun 01 01:51:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2b9a6d46-64ba-465f-96af-0eb99efb31fc tempest-GroupSnapshotsTest-1654961336 None] Group tempest-GroupSnapshotsTest-Group-1197537916: created successfully
Jun 01 01:51:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2b9a6d46-64ba-465f-96af-0eb99efb31fc tempest-GroupSnapshotsTest-1654961336 None] Create group completed successfully.
Jun 01 01:51:18 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca" returned: 0 in 1.194s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:18 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1
Jun 01 01:51:18 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:19 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1" returned: 0 in 0.750s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:19 devstack sudo[96347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1
Jun 01 01:51:19 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:20 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca.047742cb-9b67-4ca1-a2d9-af2cf115bef1" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-047742cb-9b67-4ca1-a2d9-af2cf115bef1" released by "_delete_snapshot" :: held 3.871s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-f165eba2-26fa-4d2d-9113-1f587d57a0ca" released by "delete_snapshot" :: held 3.903s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (fd810bf4-04a1-4163-a2de-f3c3b403818a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc58946-faf8-46c0-bec2-04d392ffe0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc58946-faf8-46c0-bec2-04d392ffe0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-926792681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f1d7aec8-74a7-46cc-ae7a-a0a9e0f16f9f,host='devstack@QuobyteHD#QuobyteHD',id=3fcac704-79a9-4f10-9476-e435748422a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:20Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3612d8b9-53bc-4e86-83ec-00bef02cfc7f),volume_type_id=3612d8b9-53bc-4e86-83ec-00bef02cfc7f)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58737034-09c4-42ae-b67f-d04c23f7324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58737034-09c4-42ae-b67f-d04c23f7324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476b118c-0a0e-46cc-8400-234284cad98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476b118c-0a0e-46cc-8400-234284cad98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcac704-79a9-4f10-9476-e435748422a0', 'volume_name': 'volume-3fcac704-79a9-4f10-9476-e435748422a0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27837bc0-3e33-406a-ac9c-9b4819754c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27837bc0-3e33-406a-ac9c-9b4819754c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdb423b-bc58-45d0-8a85-a65ac587184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Volume 3fcac704-79a9-4f10-9476-e435748422a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcac704-79a9-4f10-9476-e435748422a0', 'volume_size': 1}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f1d7aec8-74a7-46cc-ae7a-a0a9e0f16f9f,created_at=2026-05-31T23:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-926792681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f1d7aec8-74a7-46cc-ae7a-a0a9e0f16f9f,host='devstack@QuobyteHD#QuobyteHD',id=3fcac704-79a9-4f10-9476-e435748422a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de97395d7e404618803c55d49e9710b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:20Z,use_quota=True,user_id='36a049e1757344deacd6c32b37489eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3612d8b9-53bc-4e86-83ec-00bef02cfc7f),volume_type_id=3612d8b9-53bc-4e86-83ec-00bef02cfc7f)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Creating volume 3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:20 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:20 devstack sudo[96350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 1073741824
Jun 01 01:51:20 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['0b912041-f7f6-4154-8332-e4a4d3892a29', 'a81b160e-5f73-4dcd-ac21-aa6398eeb4af', '7662d7bb-df81-4268-9f26-f79d3394dc73', '09042e9c-2c32-4383-8a3d-032f54e8a360'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Delete snapshot completed successfully.
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-915b5eb9-72ea-4efe-a835-cf9f6a81d27c tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-047742cb-9b67-4ca1-a2d9-af2cf115bef1-delete_snapshot" released by "delete_snapshot" :: held 4.155s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-f165eba2-26fa-4d2d-9113-1f587d57a0ca-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-f165eba2-26fa-4d2d-9113-1f587d57a0ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-f165eba2-26fa-4d2d-9113-1f587d57a0ca" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-f165eba2-26fa-4d2d-9113-1f587d57a0ca" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9402119a-601e-4ad8-8eb3-02cdb0a07bd3]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:20 devstack sudo[96353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca
Jun 01 01:51:20 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:21 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 1073741824" returned: 0 in 0.997s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:21 devstack sudo[96359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0
Jun 01 01:51:21 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:21 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca" returned: 0 in 0.773s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:21 devstack sudo[96365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca
Jun 01 01:51:21 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:21 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0" returned: 0 in 0.629s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdb423b-bc58-45d0-8a85-a65ac587184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcac704-79a9-4f10-9476-e435748422a0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc50c21-fc48-4f5f-8790-adfa982a9d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:21 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Volume volume-3fcac704-79a9-4f10-9476-e435748422a0 (3fcac704-79a9-4f10-9476-e435748422a0): created successfully
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc50c21-fc48-4f5f-8790-adfa982a9d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Flow 'volume_create_manager' (fd810bf4-04a1-4163-a2de-f3c3b403818a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c46e6a40-7434-4ab1-bb3a-b3e145bdb612 tempest-GroupSnapshotsTest-1654961336 None] Created volume successfully.
Jun 01 01:51:22 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f165eba2-26fa-4d2d-9113-1f587d57a0ca" returned: 0 in 0.672s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-f165eba2-26fa-4d2d-9113-1f587d57a0ca" released by "delete_volume" :: held 1.528s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['659261a2-9fd7-4b13-9a78-495521e9e494', '338c0f06-d87f-4886-a72b-98bba05f9c02', '075de7bf-1825-4a02-9a75-6ed26e92cd37', '265a9724-cd51-4a6d-b365-9e8545c4e6d2'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:22 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:22 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] GroupSnapshot 4d3acc24-299d-44f6-b5ac-372887846ac0: creating.
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Group snapshot 4d3acc24-299d-44f6-b5ac-372887846ac0: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Creating offline snapshot 160df2fd-5742-4dcf-a038-0882ea4cfe08 of volume 3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[152e4fca-5f95-43c6-b558-dc12224393c8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:22 devstack sudo[96371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0
Jun 01 01:51:22 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-83fc94da-fbab-44f7-a534-4eaa2b6d95cb-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-83fc94da-fbab-44f7-a534-4eaa2b6d95cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:23 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.934s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Deleted volume successfully.
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "cinder-quobyte-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8879b192-2da0-4f06-8f8f-e434527848a9 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-f165eba2-26fa-4d2d-9113-1f587d57a0ca-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0b87d2-2a34-40b6-9093-9cb69af126cc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:23 devstack sudo[96374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb
Jun 01 01:51:23 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:23 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0" returned: 0 in 0.987s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:23 devstack sudo[96379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 1G
Jun 01 01:51:23 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:24 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" returned: 0 in 1.169s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:24 devstack sudo[96386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb
Jun 01 01:51:24 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:25 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 1G" returned: 0 in 1.439s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcac704-79a9-4f10-9476-e435748422a0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:25 devstack sudo[96397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcac704-79a9-4f10-9476-e435748422a0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08
Jun 01 01:51:25 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:25 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" returned: 0 in 0.797s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-quobyte-83fc94da-fbab-44f7-a534-4eaa2b6d95cb" released by "delete_volume" :: held 2.080s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Created reservations ['dca202bb-91cd-4f43-903e-8d18dc0dae0b', 'd3db084e-3254-4319-9e25-3cc4c2f0c025', '22dc342e-60fc-4e46-b1db-1e03dfb78af2', '9d601089-6c72-4e0a-9155-1713cddace66'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:25 devstack sudo[96415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:25 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:26 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcac704-79a9-4f10-9476-e435748422a0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08" returned: 0 in 1.020s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:26 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:51:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:26 devstack sudo[96421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08
Jun 01 01:51:26 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:26 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:26 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Deleted volume successfully.
Jun 01 01:51:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f9e447a5-df16-4423-baf4-3eb4a20d10b6 tempest-VolumesSnapshotTestJSON-963163312 None] Lock "cinder-83fc94da-fbab-44f7-a534-4eaa2b6d95cb-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:26 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08" returned: 0 in 0.689s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:26 devstack sudo[96426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.info
Jun 01 01:51:26 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:27 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.info" returned: 0 in 0.656s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:27 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:51:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:27 devstack sudo[96429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.info
Jun 01 01:51:27 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:28 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.info" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.560s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7bb6d18b-5286-4109-88cf-595bb6e2b6ab tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 4d3acc24-299d-44f6-b5ac-372887846ac0: created successfully
Jun 01 01:51:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 4d3acc24-299d-44f6-b5ac-372887846ac0: deleting
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 4d3acc24-299d-44f6-b5ac-372887846ac0: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-3fcac704-79a9-4f10-9476-e435748422a0" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-3fcac704-79a9-4f10-9476-e435748422a0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-160df2fd-5742-4dcf-a038-0882ea4cfe08" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-160df2fd-5742-4dcf-a038-0882ea4cfe08" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Deleting offline snapshot 160df2fd-5742-4dcf-a038-0882ea4cfe08 of volume 3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] snapshot_file for this snap is: volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d333b5da-3329-4ad4-a27a-7e660481d10d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:29 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08
Jun 01 01:51:29 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:30 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08" returned: 0 in 0.750s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fcac704-79a9-4f10-9476-e435748422a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:51:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c6d8d1-ad05-4daa-9b18-e0981e95b2ac]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:30 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0
Jun 01 01:51:30 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:31 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0" returned: 0 in 0.843s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:31 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08
Jun 01 01:51:31 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:31 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08" returned: 0 in 0.820s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:32 devstack sudo[96449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08
Jun 01 01:51:32 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:32 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0.160df2fd-5742-4dcf-a038-0882ea4cfe08" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-160df2fd-5742-4dcf-a038-0882ea4cfe08" released by "_delete_snapshot" :: held 3.315s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-3fcac704-79a9-4f10-9476-e435748422a0" released by "delete_snapshot" :: held 3.365s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:32 devstack cinder-volume[86676]: WARNING cinder.quota [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-457060707 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-457060707, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:51:32 devstack cinder-volume[86676]: WARNING cinder.quota [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-457060707 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-457060707, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:51:32 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['9e273f3e-d372-4893-b156-b63e1fd024d9', 'babeec06-b7b3-4e1c-b6e5-398464365434', 'af1c3621-8947-43a1-ac48-f49ea994add2', '91400cf8-331a-4f98-835f-1e0b4dff64a3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bad4d154-f48f-453a-aeb2-07d3c8815fe3 tempest-GroupSnapshotsTest-1654961336 None] group_snapshot 4d3acc24-299d-44f6-b5ac-372887846ac0: deleted successfully
Jun 01 01:51:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "cinder-quobyte-3fcac704-79a9-4f10-9476-e435748422a0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-3fcac704-79a9-4f10-9476-e435748422a0" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e12aeb8-b1df-49c4-8223-40c6420b1e2d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:34 devstack sudo[96452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0
Jun 01 01:51:34 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:35 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0" returned: 0 in 0.916s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:35 devstack sudo[96462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0
Jun 01 01:51:35 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:35 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3fcac704-79a9-4f10-9476-e435748422a0" returned: 0 in 0.666s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Lock "cinder-quobyte-3fcac704-79a9-4f10-9476-e435748422a0" released by "delete_volume" :: held 1.669s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['1e8a5e5f-0482-4778-9cd7-b6278be52dfb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:35 devstack cinder-volume[86676]: WARNING cinder.quota [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-457060707 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-457060707, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:51:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Created reservations ['12814587-b5b4-4b5b-ab3c-28f83bdf616e', 'cb7aa067-5126-4736-8f47-50905f65b3b5', '2c798b85-649d-4db5-bba8-5391129d9ed0', '58549c41-0163-4ca0-833e-d8693b740890'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:36 devstack sudo[96465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:36 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:37 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.131s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:37 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-df506be5-37e0-4b80-a830-98e5b62aecf2 tempest-GroupSnapshotsTest-1654961336 None] Delete group completed successfully.
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Flow 'volume_create_manager' (70486092-20d1-4b87-bada-b0ddb952e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bbf097-2c24-480b-900a-593e68a1d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bbf097-2c24-480b-900a-593e68a1d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-909639425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d13300-e2a4-4ae9-a5c1-7ba4644e1001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85364ee114144f878ce4f43f2d55e069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:38Z,use_quota=True,user_id='1f364d723ccf46c69eea2385dbdf464b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c3fb5e-d2a1-4054-93e8-0b4ce0e00b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c3fb5e-d2a1-4054-93e8-0b4ce0e00b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86144eaf-c6e3-489a-98eb-46b81cbf6890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86144eaf-c6e3-489a-98eb-46b81cbf6890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d13300-e2a4-4ae9-a5c1-7ba4644e1001', 'volume_name': 'volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b106be8-12ea-4356-acd1-569f30b2fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b106be8-12ea-4356-acd1-569f30b2fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2463ff-9b74-4c0d-8371-b8a5cb57f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001', 'volume_size': 1}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-909639425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d13300-e2a4-4ae9-a5c1-7ba4644e1001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85364ee114144f878ce4f43f2d55e069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:38Z,use_quota=True,user_id='1f364d723ccf46c69eea2385dbdf464b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Creating volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:38 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 1073741824
Jun 01 01:51:38 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:39 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 1073741824" returned: 0 in 0.909s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:39 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001
Jun 01 01:51:39 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:40 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:51:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2463ff-9b74-4c0d-8371-b8a5cb57f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e0e7eb-1e6a-4c57-8642-b380eb0c35fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Volume volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 (06d13300-e2a4-4ae9-a5c1-7ba4644e1001): created successfully
Jun 01 01:51:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e0e7eb-1e6a-4c57-8642-b380eb0c35fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Flow 'volume_create_manager' (70486092-20d1-4b87-bada-b0ddb952e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-049edf8b-8350-470e-aa0f-bf2168628dcb tempest-VolumesSnapshotListTestJSON-15290265 None] Created volume successfully.
Jun 01 01:51:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Creating offline snapshot f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 of volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:51:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e17029-fb44-458b-b3f3-59ca86a11fbd]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:41 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001
Jun 01 01:51:41 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:42 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" returned: 0 in 1.163s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:42 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 1G
Jun 01 01:51:42 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8efc0500-3dfa-4792-81f1-e3770de9515c tempest-VolumesActionsTest-459592884 None] Acquiring lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" by "attach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8efc0500-3dfa-4792-81f1-e3770de9515c tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" acquired by "attach_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8efc0500-3dfa-4792-81f1-e3770de9515c tempest-VolumesActionsTest-459592884 None] Attaching volume 7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 to instance d0134e7b-acec-477e-93bb-6fb480957cc7 at mountpoint /dev/vdb on host None.
Jun 01 01:51:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8efc0500-3dfa-4792-81f1-e3770de9515c tempest-VolumesActionsTest-459592884 None] Attach volume completed successfully.
Jun 01 01:51:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8efc0500-3dfa-4792-81f1-e3770de9515c tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" released by "attach_volume" :: held 0.215s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:44 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 1G" returned: 0 in 1.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:44 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975
Jun 01 01:51:44 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-156f0978-4c2a-4f51-92da-7b771f34d3d0 tempest-VolumesActionsTest-459592884 None] Acquiring lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:51:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-156f0978-4c2a-4f51-92da-7b771f34d3d0 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:51:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-156f0978-4c2a-4f51-92da-7b771f34d3d0 tempest-VolumesActionsTest-459592884 None] Detaching volume 7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 from instance d0134e7b-acec-477e-93bb-6fb480957cc7.
Jun 01 01:51:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-156f0978-4c2a-4f51-92da-7b771f34d3d0 tempest-VolumesActionsTest-459592884 None] Detach volume completed successfully.
Jun 01 01:51:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-156f0978-4c2a-4f51-92da-7b771f34d3d0 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:51:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-445af9cc-0e71-4f3f-8ba7-1176a29ed4ac tempest-GroupSnapshotsV319Test-600184531 None] Group tempest-GroupSnapshotsV319Test-Group-84477616: creating
Jun 01 01:51:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-445af9cc-0e71-4f3f-8ba7-1176a29ed4ac tempest-GroupSnapshotsV319Test-600184531 None] Group tempest-GroupSnapshotsV319Test-Group-84477616: created successfully
Jun 01 01:51:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-445af9cc-0e71-4f3f-8ba7-1176a29ed4ac tempest-GroupSnapshotsV319Test-600184531 None] Create group completed successfully.
Jun 01 01:51:45 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" returned: 0 in 1.504s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:45 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 is being set with open permissions: ugo+rw
Jun 01 01:51:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:45 devstack sudo[96558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975
Jun 01 01:51:45 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:46 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" returned: 0 in 1.190s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:46 devstack sudo[96600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.info
Jun 01 01:51:46 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Flow 'volume_create_manager' (e100572b-432e-402f-bb2d-4def4f5584ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522f7c5d-c63e-4b26-b168-4bb2ab804a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522f7c5d-c63e-4b26-b168-4bb2ab804a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-290341664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=707d49ae-1934-41b8-b6ca-17be262e04ab,host='devstack@QuobyteHD#QuobyteHD',id=3feb52fe-2a58-4151-b388-767832a861dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3879a0af9eb8412398a54b54b9d79b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:47Z,use_quota=True,user_id='a33e9d48f946492d8f264e656ed2dcff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6efee0a4-c31a-4f7e-af42-d8b80c1bd929),volume_type_id=6efee0a4-c31a-4f7e-af42-d8b80c1bd929)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a21e0f-8318-4838-be33-dcac12f9ccb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a21e0f-8318-4838-be33-dcac12f9ccb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9491bbdf-56af-40e8-a709-5bb68c83a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9491bbdf-56af-40e8-a709-5bb68c83a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3feb52fe-2a58-4151-b388-767832a861dd', 'volume_name': 'volume-3feb52fe-2a58-4151-b388-767832a861dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a15af7-132d-4c8d-ace7-dc78734411b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a15af7-132d-4c8d-ace7-dc78734411b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17004d83-3335-4e89-b3ca-e532c9c54f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Volume 3feb52fe-2a58-4151-b388-767832a861dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3feb52fe-2a58-4151-b388-767832a861dd', 'volume_size': 1}
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:47 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.info" returned: 0 in 0.726s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:47 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.info is being set with open permissions: ugo+rw
Jun 01 01:51:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:47 devstack sudo[96618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.info
Jun 01 01:51:47 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:48 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.info" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.314s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=707d49ae-1934-41b8-b6ca-17be262e04ab,created_at=2026-05-31T23:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-290341664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=707d49ae-1934-41b8-b6ca-17be262e04ab,host='devstack@QuobyteHD#QuobyteHD',id=3feb52fe-2a58-4151-b388-767832a861dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3879a0af9eb8412398a54b54b9d79b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:47Z,use_quota=True,user_id='a33e9d48f946492d8f264e656ed2dcff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6efee0a4-c31a-4f7e-af42-d8b80c1bd929),volume_type_id=6efee0a4-c31a-4f7e-af42-d8b80c1bd929)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Creating volume 3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:48 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:48 devstack sudo[96643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd 1073741824
Jun 01 01:51:48 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-62da687b-db6a-4055-9df5-ab39ed615a17 tempest-VolumesSnapshotListTestJSON-15290265 None] Create snapshot completed successfully
Jun 01 01:51:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:49 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd 1073741824" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:49 devstack sudo[96650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd
Jun 01 01:51:49 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:49 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd" returned: 0 in 0.630s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:51:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.180s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Creating offline snapshot 5c0a3a22-3446-4190-a5fc-b41d7b5e1fef of volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17004d83-3335-4e89-b3ca-e532c9c54f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3feb52fe-2a58-4151-b388-767832a861dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84628702-fa8f-464c-85f7-74102bdc572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed3beb0-4ab7-4355-b670-383905c56ac4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Volume volume-3feb52fe-2a58-4151-b388-767832a861dd (3feb52fe-2a58-4151-b388-767832a861dd): created successfully
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84628702-fa8f-464c-85f7-74102bdc572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Flow 'volume_create_manager' (e100572b-432e-402f-bb2d-4def4f5584ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1c075b7b-1e0e-457a-aa95-e4e345d6b6ff tempest-GroupSnapshotsV319Test-600184531 None] Created volume successfully.
Jun 01 01:51:50 devstack sudo[96653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975
Jun 01 01:51:50 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Flow 'volume_create_manager' (06b7eee7-2bf6-4c12-8f1f-96ea08edeec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7726ee-f644-443c-b8db-9eb3a6104a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7726ee-f644-443c-b8db-9eb3a6104a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1576397410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe837ef0-6a30-48ec-9f66-666884a41455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3606b8b8374c75812ba3e6863b4b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:50Z,use_quota=True,user_id='02902643a3ad4c5d903a4a525016eeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ac4f54-21d5-4ca7-a7f7-b65c89a23834),volume_type_id=42ac4f54-21d5-4ca7-a7f7-b65c89a23834)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2395046c-4df1-4717-8e33-1c009c9d0cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2395046c-4df1-4717-8e33-1c009c9d0cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8cc9ec-d020-4584-b888-adea3c94b53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8cc9ec-d020-4584-b888-adea3c94b53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe837ef0-6a30-48ec-9f66-666884a41455', 'volume_name': 'volume-fe837ef0-6a30-48ec-9f66-666884a41455', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae28f5-13de-46b7-945a-858a7eeb16c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae28f5-13de-46b7-945a-858a7eeb16c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfddc209-3c4f-472c-83c2-434949ca0a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume fe837ef0-6a30-48ec-9f66-666884a41455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe837ef0-6a30-48ec-9f66-666884a41455', 'volume_size': 1}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] GroupSnapshot 83889198-181d-4996-985b-4269e468553f: creating.
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Group snapshot 83889198-181d-4996-985b-4269e468553f: creating. {{(pid=86676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:50 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" returned: 0 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:50 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef 1G
Jun 01 01:51:50 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Flow 'volume_create_manager' (cbf36368-4d98-46fd-a3cb-77a342f752ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a336074-db13-4705-bbc0-a0c49d19a9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a336074-db13-4705-bbc0-a0c49d19a9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-767255872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf145984-ad45-41a9-a1cc-404e932d24d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3606b8b8374c75812ba3e6863b4b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:51Z,use_quota=True,user_id='02902643a3ad4c5d903a4a525016eeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51894fe2-64dd-484e-b311-b2374f767842),volume_type_id=51894fe2-64dd-484e-b311-b2374f767842)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c7d5b2-4c96-4232-8091-ccb93203fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c7d5b2-4c96-4232-8091-ccb93203fc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ca1d09-f7c8-49f6-9799-1026fa053463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ca1d09-f7c8-49f6-9799-1026fa053463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf145984-ad45-41a9-a1cc-404e932d24d3', 'volume_name': 'volume-cf145984-ad45-41a9-a1cc-404e932d24d3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c40ca48-e2c0-404b-8b36-4a91de56404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c40ca48-e2c0-404b-8b36-4a91de56404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41d0fd0-571c-4729-8015-6c25e8bf7011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume cf145984-ad45-41a9-a1cc-404e932d24d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf145984-ad45-41a9-a1cc-404e932d24d3', 'volume_size': 1}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Flow 'volume_create_manager' (14f01b2a-1a71-41fa-9b9a-907b1fefbdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e2ed3c-9e8f-40eb-ba59-2dc82f407b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e2ed3c-9e8f-40eb-ba59-2dc82f407b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-243588993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7bda73-198e-43b9-a2e3-b5ef88242755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3606b8b8374c75812ba3e6863b4b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:52Z,use_quota=True,user_id='02902643a3ad4c5d903a4a525016eeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(170e5b41-3593-42d2-ab33-4a90c931dfa5),volume_type_id=170e5b41-3593-42d2-ab33-4a90c931dfa5)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabea723-700a-438d-b74a-a6305554ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabea723-700a-438d-b74a-a6305554ffff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196d168c-f74b-4ab2-961a-7a23d5d80ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 01:51:51 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196d168c-f74b-4ab2-961a-7a23d5d80ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc7bda73-198e-43b9-a2e3-b5ef88242755', 'volume_name': 'volume-cc7bda73-198e-43b9-a2e3-b5ef88242755', 'volume_size': 1, 'image_id': 'ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1501393161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e3606b8b8374c75812ba3e6863b4b8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'created_at': datetime.datetime(2026, 5, 31, 23, 51, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 51, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72865566d9d0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6b626d-ce88-41d4-85a6-4db1cd3c4ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6b626d-ce88-41d4-85a6-4db1cd3c4ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327b205f-5698-4233-bf3c-04c1e8129459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume cc7bda73-198e-43b9-a2e3-b5ef88242755: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc7bda73-198e-43b9-a2e3-b5ef88242755', 'volume_size': 1, 'image_id': 'ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1501393161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e3606b8b8374c75812ba3e6863b4b8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'created_at': datetime.datetime(2026, 5, 31, 23, 51, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 51, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72865566d9d0>}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Trying to clone cc7bda73-198e-43b9-a2e3-b5ef88242755 from image ec5f13dc-2766-4806-9245-d0bc78ec90e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef 1G" returned: 0 in 0.955s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:51 devstack sudo[96665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef
Jun 01 01:51:51 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:52 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:51:52 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:52 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" returned: 0 in 0.730s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:52 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef is being set with open permissions: ugo+rw
Jun 01 01:51:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:52 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef
Jun 01 01:51:52 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:53 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:51:53 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.386s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.712s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1576397410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe837ef0-6a30-48ec-9f66-666884a41455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3606b8b8374c75812ba3e6863b4b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:50Z,use_quota=True,user_id='02902643a3ad4c5d903a4a525016eeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ac4f54-21d5-4ca7-a7f7-b65c89a23834),volume_type_id=42ac4f54-21d5-4ca7-a7f7-b65c89a23834)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Creating volume fe837ef0-6a30-48ec-9f66-666884a41455 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:53 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:53 devstack sudo[96679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455 1073741824
Jun 01 01:51:53 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aa09d814-1838-48dc-9515-db2750a1a391 tempest-VolumesSnapshotListTestJSON-15290265 None] Create snapshot completed successfully
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:54 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455 1073741824" returned: 0 in 0.898s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:54 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455
Jun 01 01:51:54 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:54 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455" returned: 0 in 0.609s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.149s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Creating offline snapshot 7a57cef4-b7e5-4193-9e00-c5e729792b8f of volume 3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f003e81-fc0a-44aa-9ba2-77edb3d64fe3]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfddc209-3c4f-472c-83c2-434949ca0a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe837ef0-6a30-48ec-9f66-666884a41455', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef24a6a-0795-47c2-8e5d-68f7c357337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:51:55 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume volume-fe837ef0-6a30-48ec-9f66-666884a41455 (fe837ef0-6a30-48ec-9f66-666884a41455): created successfully
Jun 01 01:51:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef24a6a-0795-47c2-8e5d-68f7c357337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:51:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Flow 'volume_create_manager' (06b7eee7-2bf6-4c12-8f1f-96ea08edeec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:51:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ca402690-ef3f-43dc-b0e8-cc2a06466b42 tempest-TestInstancesWithCinderVolumes-1318012948 None] Created volume successfully.
Jun 01 01:51:55 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd
Jun 01 01:51:55 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:55 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD, size 20.69 MB, duration 3.72 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 01:51:55 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Image download 20.69 MB at 5.56 MB/s
Jun 01 01:51:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[538a6cb4-83ab-4ddb-863d-031230df1a43]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:55 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:55 devstack sudo[96702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f 1G
Jun 01 01:51:55 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:55 devstack sudo[96701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD
Jun 01 01:51:55 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:56 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:56 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Temporary image ec5f13dc-2766-4806-9245-d0bc78ec90e2 is fetched for user 02902643a3ad4c5d903a4a525016eeac. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 01:51:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[29447297-a3c6-4cb0-8420-d69e439fbca9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:51:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:56 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f 1G" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3feb52fe-2a58-4151-b388-767832a861dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:56 devstack sudo[96715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3feb52fe-2a58-4151-b388-767832a861dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f
Jun 01 01:51:56 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:56 devstack sudo[96714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD
Jun 01 01:51:56 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:57 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD" returned: 0 in 0.709s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:57 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3feb52fe-2a58-4151-b388-767832a861dd -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f" returned: 0 in 0.669s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:57 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:51:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:57 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f
Jun 01 01:51:57 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:57 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f" returned: 0 in 0.585s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:57 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.info
Jun 01 01:51:57 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:58 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.info" returned: 0 in 0.585s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:58 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:51:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:58 devstack sudo[96730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.info
Jun 01 01:51:58 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:59 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.info" returned: 0 in 0.675s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.122s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.994s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-767255872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf145984-ad45-41a9-a1cc-404e932d24d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3606b8b8374c75812ba3e6863b4b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:51Z,use_quota=True,user_id='02902643a3ad4c5d903a4a525016eeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51894fe2-64dd-484e-b311-b2374f767842),volume_type_id=51894fe2-64dd-484e-b311-b2374f767842)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Creating volume cf145984-ad45-41a9-a1cc-404e932d24d3 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:51:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:51:59 devstack sudo[96734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3 1073741824
Jun 01 01:51:59 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:51:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-76745ece-4e4f-4146-8d56-8e772e6bd468 tempest-GroupSnapshotsV319Test-600184531 None] group_snapshot 83889198-181d-4996-985b-4269e468553f: created successfully
Jun 01 01:51:59 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root
Jun 01 01:51:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3 1073741824" returned: 0 in 0.914s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:00 devstack sudo[96739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3
Jun 01 01:52:00 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] group_snapshot 83889198-181d-4996-985b-4269e468553f: deleting
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] group_snapshot 83889198-181d-4996-985b-4269e468553f: deleting {{(pid=86676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 01 01:52:00 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3" returned: 0 in 0.755s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.566s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41d0fd0-571c-4729-8015-6c25e8bf7011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf145984-ad45-41a9-a1cc-404e932d24d3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6713c-7f31-4ae1-b1bb-79c9b1bca2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Acquiring lock "cinder-quobyte-3feb52fe-2a58-4151-b388-767832a861dd" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Creating offline snapshot b4982c4b-7a50-48c8-8fcb-9b80711a9186 of volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:52:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume volume-cf145984-ad45-41a9-a1cc-404e932d24d3 (cf145984-ad45-41a9-a1cc-404e932d24d3): created successfully
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6713c-7f31-4ae1-b1bb-79c9b1bca2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Flow 'volume_create_manager' (cbf36368-4d98-46fd-a3cb-77a342f752ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e92a5ab-7d1e-45aa-baf0-743dff7c87ee]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Lock "cinder-quobyte-3feb52fe-2a58-4151-b388-767832a861dd" acquired by "delete_snapshot" :: waited 0.104s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Acquiring lock "cinder-quobyte-7a57cef4-b7e5-4193-9e00-c5e729792b8f" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d038349d-f95a-4ea9-9539-36e10c089dd4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Created volume successfully.
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Lock "cinder-quobyte-7a57cef4-b7e5-4193-9e00-c5e729792b8f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Deleting offline snapshot 7a57cef4-b7e5-4193-9e00-c5e729792b8f of volume 3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] snapshot_file for this snap is: volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[562aafeb-8bd0-4fe0-98ee-94a44e95a6e5]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:01 devstack sudo[96760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef
Jun 01 01:52:01 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:01 devstack sudo[96761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f
Jun 01 01:52:01 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:01 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" returned: 0 in 0.764s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:52:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:01 devstack sudo[96770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 1G
Jun 01 01:52:01 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:01 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f" returned: 0 in 0.781s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3feb52fe-2a58-4151-b388-767832a861dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:52:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a88411-c5f9-4e4f-8214-bb48e8e7c3a7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:01 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd
Jun 01 01:52:01 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:02 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:02 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 1G" returned: 0 in 0.906s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:02 devstack sudo[96780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186
Jun 01 01:52:02 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:02 devstack sudo[96781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f
Jun 01 01:52:02 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:03 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186" returned: 0 in 0.678s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:03 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 is being set with open permissions: ugo+rw
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:03 devstack sudo[96790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186
Jun 01 01:52:03 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:03 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:03 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f
Jun 01 01:52:03 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:03 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186" returned: 0 in 0.598s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.759s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-243588993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7bda73-198e-43b9-a2e3-b5ef88242755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3606b8b8374c75812ba3e6863b4b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:51:52Z,use_quota=True,user_id='02902643a3ad4c5d903a4a525016eeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(170e5b41-3593-42d2-ab33-4a90c931dfa5),volume_type_id=170e5b41-3593-42d2-ab33-4a90c931dfa5)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Creating volume cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:52:03 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:03 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:03 devstack sudo[96800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 1073741824
Jun 01 01:52:03 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd.7a57cef4-b7e5-4193-9e00-c5e729792b8f" returned: 0 in 0.619s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Lock "cinder-quobyte-7a57cef4-b7e5-4193-9e00-c5e729792b8f" released by "_delete_snapshot" :: held 3.012s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:03 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-12a7aa85-8354-411d-990c-2c095aa714bc tempest-VolumesSnapshotListTestJSON-15290265 None] Create snapshot completed successfully
Jun 01 01:52:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Lock "cinder-quobyte-3feb52fe-2a58-4151-b388-767832a861dd" released by "delete_snapshot" :: held 3.057s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:04 devstack cinder-volume[86676]: WARNING cinder.quota [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2133951464 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2133951464, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:52:04 devstack cinder-volume[86676]: WARNING cinder.quota [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2133951464 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2133951464, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:52:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] Created reservations ['439b7469-e61c-4c6e-9ec7-8a69f2a8b835', '375e3434-0163-4ef7-97aa-018a8074c528', 'c641e332-7858-4f76-a601-d1ee51a69494', '79002fc3-042a-4bec-8f80-7f5b7f74cb4d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-02bd4578-29ed-43cf-9715-8a9d1a0c2f15 tempest-GroupSnapshotsV319Test-600184531 None] group_snapshot 83889198-181d-4996-985b-4269e468553f: deleted successfully
Jun 01 01:52:04 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 1073741824" returned: 0 in 0.824s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:04 devstack sudo[96806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:52:04 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Acquiring lock "cinder-quobyte-3feb52fe-2a58-4151-b388-767832a861dd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Lock "cinder-quobyte-3feb52fe-2a58-4151-b388-767832a861dd" acquired by "delete_volume" :: waited 0.074s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[98598133-eff6-41ab-a047-7cfa9435cb57]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:05 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 0 in 0.764s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Attempting download of ec5f13dc-2766-4806-9245-d0bc78ec90e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'metadata': {}}])) to volume cc7bda73-198e-43b9-a2e3-b5ef88242755. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-b4982c4b-7a50-48c8-8fcb-9b80711a9186-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-b4982c4b-7a50-48c8-8fcb-9b80711a9186-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce5e3c6-4883-4143-b2b5-66ac8cd84634]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec5f13dc-2766-4806-9245-d0bc78ec90e2_1z5frx6e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:05 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd
Jun 01 01:52:05 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-quobyte-b4982c4b-7a50-48c8-8fcb-9b80711a9186" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-b4982c4b-7a50-48c8-8fcb-9b80711a9186" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Deleting offline snapshot b4982c4b-7a50-48c8-8fcb-9b80711a9186 of volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] snapshot_file for this snap is: volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2b27f-3fd5-488d-8e42-629c3836d32f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:06 devstack sudo[96858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec5f13dc-2766-4806-9245-d0bc78ec90e2_1z5frx6e
Jun 01 01:52:06 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:06 devstack sudo[96865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186
Jun 01 01:52:06 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:06 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd" returned: 0 in 1.132s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:06 devstack sudo[96880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd
Jun 01 01:52:06 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:07 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec5f13dc-2766-4806-9245-d0bc78ec90e2_1z5frx6e" returned: 0 in 1.308s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec5f13dc-2766-4806-9245-d0bc78ec90e2_1z5frx6e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:07 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186" returned: 0 in 1.279s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:52:07 devstack sudo[96888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec5f13dc-2766-4806-9245-d0bc78ec90e2_1z5frx6e
Jun 01 01:52:07 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8947e8f-c4b6-40df-b491-c02ac333e748]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:07 devstack sudo[96892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef
Jun 01 01:52:07 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:07 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-3feb52fe-2a58-4151-b388-767832a861dd" returned: 0 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Lock "cinder-quobyte-3feb52fe-2a58-4151-b388-767832a861dd" released by "delete_volume" :: held 2.144s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Created reservations ['00718670-17a8-4bdb-8687-33db4b74077a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:07 devstack cinder-volume[86676]: WARNING cinder.quota [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2133951464 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2133951464, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Created reservations ['60826185-d7b8-4b22-b981-fd4e22c4783c', '81b585a1-e13d-4146-8c3b-b21ee8b84a52', 'd60e3af0-c049-4903-93db-d88d9d21ba86', '2e560f14-57d2-4f7d-a060-376166ad5363'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:07 devstack sudo[96895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:52:07 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:08 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec5f13dc-2766-4806-9245-d0bc78ec90e2_1z5frx6e" returned: 1 in 0.999s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec5f13dc-2766-4806-9245-d0bc78ec90e2_1z5frx6e' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ab988-2c0c-4cc9-bd2d-d1b895b86604]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:08 devstack sudo[96898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD
Jun 01 01:52:08 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:08 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" returned: 0 in 1.145s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:08 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186
Jun 01 01:52:08 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:08 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.056s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:08 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:52:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a56226cd-f081-4df9-839f-a38452712e39 tempest-GroupSnapshotsV319Test-600184531 None] Delete group completed successfully.
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1b3beda8-b093-429e-ad1e-60f915f14d26 tempest-VolumesActionsTest-459592884 None] Acquiring lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" by "attach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1b3beda8-b093-429e-ad1e-60f915f14d26 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" acquired by "attach_volume" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1b3beda8-b093-429e-ad1e-60f915f14d26 tempest-VolumesActionsTest-459592884 None] Attaching volume 7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 to instance b146bdd2-e3a2-455e-8d60-cd18d79f5e89 at mountpoint /dev/vdb on host None.
Jun 01 01:52:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1b3beda8-b093-429e-ad1e-60f915f14d26 tempest-VolumesActionsTest-459592884 None] Attach volume completed successfully.
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1b3beda8-b093-429e-ad1e-60f915f14d26 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" released by "attach_volume" :: held 0.145s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:09 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD" returned: 0 in 1.266s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] ec5f13dc-2766-4806-9245-d0bc78ec90e2 was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:09 devstack sudo[96912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:52:09 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:09 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186" returned: 0 in 1.400s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:09 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186
Jun 01 01:52:09 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c10130b-1b8b-4de2-aa2b-e0834e50dbd0 tempest-VolumesActionsTest-459592884 None] Acquiring lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-detach_volume" by "detach_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c10130b-1b8b-4de2-aa2b-e0834e50dbd0 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8c10130b-1b8b-4de2-aa2b-e0834e50dbd0 tempest-VolumesActionsTest-459592884 None] Detaching volume 7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 from instance b146bdd2-e3a2-455e-8d60-cd18d79f5e89.
Jun 01 01:52:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8c10130b-1b8b-4de2-aa2b-e0834e50dbd0 tempest-VolumesActionsTest-459592884 None] Detach volume completed successfully.
Jun 01 01:52:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8c10130b-1b8b-4de2-aa2b-e0834e50dbd0 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:10 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.b4982c4b-7a50-48c8-8fcb-9b80711a9186" returned: 0 in 1.062s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-b4982c4b-7a50-48c8-8fcb-9b80711a9186" released by "_delete_snapshot" :: held 5.107s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" released by "delete_snapshot" :: held 5.169s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Created reservations ['7130fa22-e907-4395-a8d1-db615ca082e9', '99e13fde-23b2-4f45-9da5-3ac6292354ee', '7241518e-b2a3-48d4-b7a2-4ce07619560e', '091f0d68-7971-48db-9d4f-5ac5c981d380'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Delete snapshot completed successfully.
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-644d1a36-6e57-4b97-b547-b1a808345053 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-b4982c4b-7a50-48c8-8fcb-9b80711a9186-delete_snapshot" released by "delete_snapshot" :: held 5.478s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-5c0a3a22-3446-4190-a5fc-b41d7b5e1fef-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-5c0a3a22-3446-4190-a5fc-b41d7b5e1fef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-quobyte-5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Deleting offline snapshot 5c0a3a22-3446-4190-a5fc-b41d7b5e1fef of volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] snapshot_file for this snap is: volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa853f5-49b2-491a-b529-dee2e2383b2f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:11 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef
Jun 01 01:52:11 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:12 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 0 in 2.911s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:12 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec5f13dc-2766-4806-9245-d0bc78ec90e2_oas_3ot7devstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:52:12 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Converted 112.00 MB image at 38.46 MB/s
Jun 01 01:52:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:12 devstack sudo[96964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 1G
Jun 01 01:52:12 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:12 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" returned: 0 in 1.142s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:52:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7b758c-591e-4b56-93cf-a475c955c53f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:12 devstack sudo[96971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975
Jun 01 01:52:12 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:13 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 1G" returned: 0 in 0.867s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3883683d-c78e-4b9c-9c07-c318896784c5]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:13 devstack sudo[96977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:52:13 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:13 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" returned: 0 in 0.905s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:52:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:13 devstack sudo[96982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef
Jun 01 01:52:13 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:14 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 0 in 0.889s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:14 devstack sudo[96987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:52:14 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:14 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" returned: 0 in 0.921s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:14 devstack sudo[96993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef
Jun 01 01:52:14 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:14 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 1 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Downloaded image ec5f13dc-2766-4806-9245-d0bc78ec90e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'metadata': {}}])) to volume cc7bda73-198e-43b9-a2e3-b5ef88242755 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Temporary image ec5f13dc-2766-4806-9245-d0bc78ec90e2 for user 02902643a3ad4c5d903a4a525016eeac is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Marking volume cc7bda73-198e-43b9-a2e3-b5ef88242755 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Copying metadata from image ec5f13dc-2766-4806-9245-d0bc78ec90e2 to cc7bda73-198e-43b9-a2e3-b5ef88242755. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Creating volume glance metadata for volume cc7bda73-198e-43b9-a2e3-b5ef88242755 backed by image ec5f13dc-2766-4806-9245-d0bc78ec90e2 with: {'image_id': 'ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'image_name': 'tempest-scenario-img--1501393161', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327b205f-5698-4233-bf3c-04c1e8129459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7bda73-198e-43b9-a2e3-b5ef88242755', 'volume_size': 1, 'image_id': 'ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1501393161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e3606b8b8374c75812ba3e6863b4b8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ec5f13dc-2766-4806-9245-d0bc78ec90e2', 'created_at': datetime.datetime(2026, 5, 31, 23, 51, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 51, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec5f13dc-2766-4806-9245-d0bc78ec90e2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72865566d9d0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f16b89-761b-4ab6-a702-fc4dc549205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Volume volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 (cc7bda73-198e-43b9-a2e3-b5ef88242755): created successfully
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f16b89-761b-4ab6-a702-fc4dc549205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Flow 'volume_create_manager' (14f01b2a-1a71-41fa-9b9a-907b1fefbdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2405d768-9ef4-41af-87ad-f13480ef7995 tempest-TestInstancesWithCinderVolumes-1318012948 None] Created volume successfully.
Jun 01 01:52:15 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" returned: 0 in 0.674s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-5c0a3a22-3446-4190-a5fc-b41d7b5e1fef" released by "_delete_snapshot" :: held 3.852s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" released by "delete_snapshot" :: held 3.885s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Created reservations ['cf3070d9-8a46-4bf3-9629-a19b2b0933b9', '36c40b9e-b55b-4346-86c5-36d85b8943a3', '7c9d7500-3716-40ec-978c-f0fe2400451e', '942f6766-4454-47db-964b-4114b09aa779'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Delete snapshot completed successfully.
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b3dfeee2-b653-4bea-9f82-452dbb7fcfbc tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-5c0a3a22-3446-4190-a5fc-b41d7b5e1fef-delete_snapshot" released by "delete_snapshot" :: held 4.059s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-f14d7b3d-7264-4293-b6e9-0ba5bcdcc975-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-f14d7b3d-7264-4293-b6e9-0ba5bcdcc975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-quobyte-f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Deleting offline snapshot f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 of volume 06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] snapshot_file for this snap is: volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bccdf6-24f2-49b5-a9ed-9319aecbd593]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:15 devstack sudo[96999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975
Jun 01 01:52:15 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5fecfd87-6424-4ad1-b33e-e2ef39c4db7e tempest-GroupsTest-1149856558 None] Group tempest-Group1-550682323: creating
Jun 01 01:52:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5fecfd87-6424-4ad1-b33e-e2ef39c4db7e tempest-GroupsTest-1149856558 None] Group tempest-Group1-550682323: created successfully
Jun 01 01:52:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5fecfd87-6424-4ad1-b33e-e2ef39c4db7e tempest-GroupsTest-1149856558 None] Create group completed successfully.
Jun 01 01:52:16 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" returned: 0 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:52:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba11c90-0b3c-4ef3-acfa-8028fc8faeb2]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:16 devstack sudo[97005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001
Jun 01 01:52:16 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:17 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=110,cinder:UPDATE=115,cinder:INSERT=32,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:52:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cf7fbf96-2a76-447e-8c05-00a0dac974a7 tempest-GroupsTest-1149856558 None] Group tempest-Group2-1878122008: creating
Jun 01 01:52:17 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:INSERT=29,cinder:SELECT=126,cinder:UPDATE=117,cinder:DELETE=6 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:52:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cf7fbf96-2a76-447e-8c05-00a0dac974a7 tempest-GroupsTest-1149856558 None] Group tempest-Group2-1878122008: created successfully
Jun 01 01:52:17 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cf7fbf96-2a76-447e-8c05-00a0dac974a7 tempest-GroupsTest-1149856558 None] Create group completed successfully.
Jun 01 01:52:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" returned: 0 in 0.786s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:17 devstack sudo[97013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975
Jun 01 01:52:17 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:18 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:18 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975
Jun 01 01:52:18 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:18 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001.f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-f14d7b3d-7264-4293-b6e9-0ba5bcdcc975" released by "_delete_snapshot" :: held 3.202s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" released by "delete_snapshot" :: held 3.233s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Flow 'volume_create_manager' (a931821b-e22e-483b-a610-b5250f82436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eac6603-3268-4602-a380-9e1af05b603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eac6603-3268-4602-a380-9e1af05b603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1817394178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5da3d131-cad7-4b94-a847-29aa34174b46,host='devstack@QuobyteHD#QuobyteHD',id=259349c3-35fe-4b37-b5dd-bcdd5920f0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b99c138178453db917eda71b3adf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:19Z,use_quota=True,user_id='f288f817b18d4c54bdbdacd3e9a60ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1e04b3-a43c-4d06-a284-247fa098a44b),volume_type_id=ef1e04b3-a43c-4d06-a284-247fa098a44b)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e34bb-9b7f-4449-a34b-f5ca50cc07ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e34bb-9b7f-4449-a34b-f5ca50cc07ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fe2df6-a453-41de-885b-887804e83152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fe2df6-a453-41de-885b-887804e83152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259349c3-35fe-4b37-b5dd-bcdd5920f0ca', 'volume_name': 'volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f32daf2-1408-4bce-917d-f110fa7db19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f32daf2-1408-4bce-917d-f110fa7db19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef13b03-ada8-4015-ab30-9f4243a494bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Volume 259349c3-35fe-4b37-b5dd-bcdd5920f0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca', 'volume_size': 1}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5da3d131-cad7-4b94-a847-29aa34174b46,created_at=2026-05-31T23:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1817394178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5da3d131-cad7-4b94-a847-29aa34174b46,host='devstack@QuobyteHD#QuobyteHD',id=259349c3-35fe-4b37-b5dd-bcdd5920f0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b99c138178453db917eda71b3adf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:19Z,use_quota=True,user_id='f288f817b18d4c54bdbdacd3e9a60ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1e04b3-a43c-4d06-a284-247fa098a44b),volume_type_id=ef1e04b3-a43c-4d06-a284-247fa098a44b)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Creating volume 259349c3-35fe-4b37-b5dd-bcdd5920f0ca {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:52:18 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:52:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:19 devstack sudo[97022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca 1073741824
Jun 01 01:52:19 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Created reservations ['4b621c0f-ebbb-4174-ad27-8d28bd581dfc', '5998ab0d-9da3-4be2-86c3-5daac37d9a9c', '3b08a412-3e89-4948-8786-f9905544b10e', 'f8cfbaf3-ef78-4e9d-973f-3e6542154712'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Delete snapshot completed successfully.
Jun 01 01:52:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9be21bac-5d61-4dfe-b76c-88aab411c556 tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-f14d7b3d-7264-4293-b6e9-0ba5bcdcc975-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:19 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca 1073741824" returned: 0 in 0.822s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:19 devstack sudo[97028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca
Jun 01 01:52:19 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-06d13300-e2a4-4ae9-a5c1-7ba4644e1001-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-06d13300-e2a4-4ae9-a5c1-7ba4644e1001-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3671e4bd-e900-49e1-831c-14a7b2f892c7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:20 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001
Jun 01 01:52:20 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:20 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca" returned: 0 in 0.630s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.131s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef13b03-ada8-4015-ab30-9f4243a494bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30e7f9a-75e3-4729-86b4-a07e65970cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff35c71-1da3-41ea-97cc-a0c0a1192716]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Volume volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca (259349c3-35fe-4b37-b5dd-bcdd5920f0ca): created successfully
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30e7f9a-75e3-4729-86b4-a07e65970cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Flow 'volume_create_manager' (a931821b-e22e-483b-a610-b5250f82436a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aefb5098-5f3b-4112-b117-16b1b5131a2c tempest-GroupsTest-1149856558 None] Created volume successfully.
Jun 01 01:52:20 devstack sudo[97033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:52:20 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:20 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" returned: 0 in 0.697s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:20 devstack sudo[97039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001
Jun 01 01:52:20 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:21 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfd40d2-15cf-4938-82ea-a585fabb3c22]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:21 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" returned: 0 in 0.629s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:21 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:52:21 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-quobyte-06d13300-e2a4-4ae9-a5c1-7ba4644e1001" released by "delete_volume" :: held 1.405s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Created reservations ['9e488839-be24-4e3e-ac1e-a4536e5c78e8', 'eb585bf1-443d-4917-82ae-291e6cce5c54', '661ca346-bde5-4755-af35-756b2cca9f0d', 'dcf00ae6-1937-443a-a5b6-57946ee04a2f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:21 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:52:21 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Acquiring lock "cinder-quobyte-259349c3-35fe-4b37-b5dd-bcdd5920f0ca" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Lock "cinder-quobyte-259349c3-35fe-4b37-b5dd-bcdd5920f0ca" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c922a3-698a-4bda-92cd-b26865f5090c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:21 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca
Jun 01 01:52:21 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:22 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 1.044s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.26bc0e5a-21bb-4217-9335-45b17509b657hh4nqy7w.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:22 devstack sudo[97055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.26bc0e5a-21bb-4217-9335-45b17509b657hh4nqy7w.img
Jun 01 01:52:22 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:22 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:22 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:52:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Deleted volume successfully.
Jun 01 01:52:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-35417423-59a2-4750-b676-969438d1b1ec tempest-VolumesSnapshotListTestJSON-15290265 None] Lock "cinder-06d13300-e2a4-4ae9-a5c1-7ba4644e1001-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:22 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca" returned: 0 in 1.101s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:22 devstack sudo[97060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca
Jun 01 01:52:22 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:23 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-259349c3-35fe-4b37-b5dd-bcdd5920f0ca" returned: 0 in 1.166s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Lock "cinder-quobyte-259349c3-35fe-4b37-b5dd-bcdd5920f0ca" released by "delete_volume" :: held 2.352s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Created reservations ['c08a1f9e-c662-4469-be29-13d00e494ddc'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:24 devstack cinder-volume[86676]: WARNING cinder.quota [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-394735174 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-394735174, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:52:24 devstack cinder-volume[86676]: WARNING cinder.quota [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-394735174 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-394735174, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Created reservations ['fb460d5a-1fef-4dce-9b8d-aeee6829b7d4', '165bd0dc-ce8b-470d-8f42-523418293ed2', '4f8befad-89cd-44dd-87a2-d8701e9966e6', '75a2057f-9fb8-4d61-b3a4-92b504c67c9a'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:24 devstack sudo[97081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:52:24 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:25 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Created reservations ['289f0032-dcea-42f0-88af-6e3a337a1a2b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:52:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:25 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.366s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:26 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:52:26 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:52:26 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3b78b485-b608-41be-b5bf-9adcde1d794f tempest-GroupsTest-1149856558 None] Delete group completed successfully.
Jun 01 01:52:27 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:27 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:52:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ce2afc03-c189-4d15-bccd-5e99fe0f406c tempest-GroupsTest-1149856558 None] Delete group completed successfully.
Jun 01 01:52:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-02962aa2-5613-4e2e-be1a-b30dcfd6e5b6 tempest-GroupsTest-1149856558 None] Group tempest-GroupsTest-Group-323942522: creating
Jun 01 01:52:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-02962aa2-5613-4e2e-be1a-b30dcfd6e5b6 tempest-GroupsTest-1149856558 None] Group tempest-GroupsTest-Group-323942522: created successfully
Jun 01 01:52:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-02962aa2-5613-4e2e-be1a-b30dcfd6e5b6 tempest-GroupsTest-1149856558 None] Create group completed successfully.
Jun 01 01:52:29 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.26bc0e5a-21bb-4217-9335-45b17509b657hh4nqy7w.img" returned: 0 in 7.008s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4687ea8-b1f0-400d-a09a-423673e1273d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:29 devstack sudo[97090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:52:29 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Flow 'volume_create_manager' (6897314d-5c64-4101-a41c-12220177768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee87fea-1c3a-4c2c-b802-85b44d8841ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee87fea-1c3a-4c2c-b802-85b44d8841ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-135087771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1fe093-b157-4dc4-887d-5a1dc84e6529,host='devstack@QuobyteHD#QuobyteHD',id=b3718689-0b0d-4996-84ff-2bf049831b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b99c138178453db917eda71b3adf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:30Z,use_quota=True,user_id='f288f817b18d4c54bdbdacd3e9a60ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80fcf6ab-8284-4282-a774-81216a280050),volume_type_id=80fcf6ab-8284-4282-a774-81216a280050)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc70dcb-1b86-4688-a445-32fdf0112e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc70dcb-1b86-4688-a445-32fdf0112e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed3ae1b-4331-4977-ae40-bab8b4502e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed3ae1b-4331-4977-ae40-bab8b4502e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3718689-0b0d-4996-84ff-2bf049831b36', 'volume_name': 'volume-b3718689-0b0d-4996-84ff-2bf049831b36', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4ec66f-4245-459f-8430-af63bc4c675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4ec66f-4245-459f-8430-af63bc4c675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c53f3be-91fe-418a-91b8-44abf4f2f1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Volume b3718689-0b0d-4996-84ff-2bf049831b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3718689-0b0d-4996-84ff-2bf049831b36', 'volume_size': 1}
Jun 01 01:52:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:30 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 0.943s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.26bc0e5a-21bb-4217-9335-45b17509b657hh4nqy7w.img {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:52:30 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Converted 1024.00 MB image at 146.10 MB/s
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] 26bc0e5a-21bb-4217-9335-45b17509b657 was raw, no need to convert to raw {{(pid=86676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Flow 'volume_create_manager' (b6ecee09-b968-42f8-8f25-22646380543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d92d2b-df22-4e88-a762-cce614be223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d92d2b-df22-4e88-a762-cce614be223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1048781576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e42fde-bb44-4962-8969-fe181add4680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7764df9420429284d28edd16d02527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:30Z,use_quota=True,user_id='089f338215d442369896e20c64c4ff5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f776990c-fba6-4e9c-92ad-68985c0b88d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f776990c-fba6-4e9c-92ad-68985c0b88d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f32524b-9d10-455c-a7c4-c6ed4541b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f32524b-9d10-455c-a7c4-c6ed4541b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e42fde-bb44-4962-8969-fe181add4680', 'volume_name': 'volume-20e42fde-bb44-4962-8969-fe181add4680', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403724ac-d29b-42be-92f3-49246b4ec83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403724ac-d29b-42be-92f3-49246b4ec83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ab4534-36ff-4170-a3f8-6494d8bfe48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Volume 20e42fde-bb44-4962-8969-fe181add4680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e42fde-bb44-4962-8969-fe181add4680', 'volume_size': 2}
Jun 01 01:52:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=30,cinder:SELECT=36,cinder:INSERT=9 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:52:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=32,cinder:UPDATE=36,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.227s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Uploaded volume to glance image-id: 26bc0e5a-21bb-4217-9335-45b17509b657. {{(pid=86676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}}
Jun 01 01:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.511s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1ce28a2a-ffc6-4f09-8f34-21dd7a759227 tempest-VolumesActionsTest-459592884 None] Copy volume to image completed successfully.
Jun 01 01:52:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d6c7d-058d-4756-85e8-4f2a10446c7d]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:48 devstack sudo[97134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:52:48 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:49 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 0 in 0.691s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:49 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:52:49 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:50 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 1 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.441s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.364s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f1fe093-b157-4dc4-887d-5a1dc84e6529,created_at=2026-05-31T23:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-135087771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1fe093-b157-4dc4-887d-5a1dc84e6529,host='devstack@QuobyteHD#QuobyteHD',id=b3718689-0b0d-4996-84ff-2bf049831b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b99c138178453db917eda71b3adf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:30Z,use_quota=True,user_id='f288f817b18d4c54bdbdacd3e9a60ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80fcf6ab-8284-4282-a774-81216a280050),volume_type_id=80fcf6ab-8284-4282-a774-81216a280050)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Creating volume b3718689-0b0d-4996-84ff-2bf049831b36 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:52:50 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:50 devstack sudo[97143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36 1073741824
Jun 01 01:52:50 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-cc7bda73-198e-43b9-a2e3-b5ef88242755', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8795ca43-2e06-473c-8252-8b7bc780f8f7', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:52:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-83fb587a-455c-4444-b708-dfb536052acf req-9757f1b5-0178-43c1-945c-8e639e88db8f tempest-TestInstancesWithCinderVolumes-1318012948 None] attachment_update completed successfully.
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:50 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36 1073741824" returned: 0 in 0.801s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:51 devstack sudo[97149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36
Jun 01 01:52:51 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:51 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36" returned: 0 in 0.589s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.053s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1048781576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e42fde-bb44-4962-8969-fe181add4680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7764df9420429284d28edd16d02527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:30Z,use_quota=True,user_id='089f338215d442369896e20c64c4ff5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Creating volume 20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:52:51 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 2147483648 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:51 devstack sudo[97152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 2147483648
Jun 01 01:52:51 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c53f3be-91fe-418a-91b8-44abf4f2f1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3718689-0b0d-4996-84ff-2bf049831b36', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08b1489-6b14-4ae7-bc4b-4b70aa595ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Volume volume-b3718689-0b0d-4996-84ff-2bf049831b36 (b3718689-0b0d-4996-84ff-2bf049831b36): created successfully
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08b1489-6b14-4ae7-bc4b-4b70aa595ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Flow 'volume_create_manager' (6897314d-5c64-4101-a41c-12220177768f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0126559f-0f68-40dd-82b6-99c6c470ec25 tempest-GroupsTest-1149856558 None] Created volume successfully.
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:52 devstack sudo[97157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:52:52 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:52 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 2147483648" returned: 0 in 0.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:52 devstack sudo[97183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680
Jun 01 01:52:52 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:53 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.653s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:52:53 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.855s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ab4534-36ff-4170-a3f8-6494d8bfe48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e42fde-bb44-4962-8969-fe181add4680', 'volume_size': 2}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f0d9b8-24a7-4c53-b0fd-5ecfb6bef042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[66702ff4-de40-4261-963c-a4f99050ee80]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:53 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Volume volume-20e42fde-bb44-4962-8969-fe181add4680 (20e42fde-bb44-4962-8969-fe181add4680): created successfully
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f0d9b8-24a7-4c53-b0fd-5ecfb6bef042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Flow 'volume_create_manager' (b6ecee09-b968-42f8-8f25-22646380543c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aa761992-d395-49e1-b021-c373ef61166d tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Created volume successfully.
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Flow 'volume_create_manager' (085e364c-a257-47fc-bb0e-3b28e451531f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97ee34d-d739-4ea9-aadb-340b55e42b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:53 devstack sudo[97232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:52:53 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97ee34d-d739-4ea9-aadb-340b55e42b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1939380213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1fe093-b157-4dc4-887d-5a1dc84e6529,host='devstack@QuobyteHD#QuobyteHD',id=80294d2c-42b9-42d6-a8fa-4aa1a082d40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b99c138178453db917eda71b3adf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:53Z,use_quota=True,user_id='f288f817b18d4c54bdbdacd3e9a60ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80fcf6ab-8284-4282-a774-81216a280050),volume_type_id=80fcf6ab-8284-4282-a774-81216a280050)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83a9088-210c-4e65-a6b8-2f6b1e226b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83a9088-210c-4e65-a6b8-2f6b1e226b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89405298-2b66-4af5-befe-2b837b9fbc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89405298-2b66-4af5-befe-2b837b9fbc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80294d2c-42b9-42d6-a8fa-4aa1a082d40c', 'volume_name': 'volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d8b5de-0d13-4a41-af05-daa32004c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d8b5de-0d13-4a41-af05-daa32004c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce84efa-e712-4a70-af39-40846acd9662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:52:53 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Volume 80294d2c-42b9-42d6-a8fa-4aa1a082d40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c', 'volume_size': 1}
Jun 01 01:52:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:54 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3968cd25-7f66-438a-864c-d84cabe8dc06]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:52:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:52:54 devstack sudo[97246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:52:54 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:52:54 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root
Jun 01 01:52:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:52:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:52:54 devstack sudo[97251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img
Jun 01 01:52:54 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:01 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img" returned: 0 in 6.488s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a785168e-d127-43d6-b560-f602bd119936]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:01 devstack sudo[97643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:53:01 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:02 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 1.017s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:02 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:53:02 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Converted 1024.00 MB image at 157.80 MB/s
Jun 01 01:53:02 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] b16acbf5-4bfa-4564-b1f6-d904fa90023f was raw, converting to qcow2 {{(pid=86676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 01 01:53:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e01f1-6069-48e6-a4d8-7535c3f1ac8b]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:02 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img
Jun 01 01:53:02 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:03 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img" returned: 0 in 0.814s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:03 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img
Jun 01 01:53:03 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:03 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img" returned: 1 in 0.734s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:53:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img /opt/stack/data/cinder/conversion/vol_upload_ztmygl0e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:03 devstack sudo[97661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img /opt/stack/data/cinder/conversion/vol_upload_ztmygl0e
Jun 01 01:53:03 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:04 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img /opt/stack/data/cinder/conversion/vol_upload_ztmygl0e" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:04 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Image conversion details: src /opt/stack/data/cinder/conversion/7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2.temp_image.b16acbf5-4bfa-4564-b1f6-d904fa90023fb7sfkeyk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ztmygl0e {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:53:04 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 01 01:53:04 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d92be5-077f-4071-959d-f4f15e38ff29]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ztmygl0e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:04 devstack sudo[97666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ztmygl0e
Jun 01 01:53:04 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:05 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ztmygl0e" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.703s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Uploaded volume to glance image-id: b16acbf5-4bfa-4564-b1f6-d904fa90023f. {{(pid=86676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.515s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f1fe093-b157-4dc4-887d-5a1dc84e6529,created_at=2026-05-31T23:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1939380213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1fe093-b157-4dc4-887d-5a1dc84e6529,host='devstack@QuobyteHD#QuobyteHD',id=80294d2c-42b9-42d6-a8fa-4aa1a082d40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b99c138178453db917eda71b3adf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:52:53Z,use_quota=True,user_id='f288f817b18d4c54bdbdacd3e9a60ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80fcf6ab-8284-4282-a774-81216a280050),volume_type_id=80fcf6ab-8284-4282-a774-81216a280050)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Creating volume 80294d2c-42b9-42d6-a8fa-4aa1a082d40c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:53:06 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:53:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:06 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c 1073741824
Jun 01 01:53:06 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-963a7299-db0a-48bc-af62-a0a27a1ab136 tempest-VolumesActionsTest-459592884 None] Copy volume to image completed successfully.
Jun 01 01:53:07 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c 1073741824" returned: 0 in 0.927s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:07 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c
Jun 01 01:53:07 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Acquiring lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Acquiring lock "cinder-quobyte-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Lock "cinder-quobyte-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e8834-c014-4c97-999b-89d2ffe3ac55]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:08 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:53:08 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:08 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c" returned: 0 in 0.591s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.431s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce84efa-e712-4a70-af39-40846acd9662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6b3ac7-6f9a-4c84-9a3b-0b764c0cece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Creating offline snapshot e8bb6dc6-8e60-4653-bc52-6527ff5e21ab of volume 20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:53:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Volume volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c (80294d2c-42b9-42d6-a8fa-4aa1a082d40c): created successfully
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6b3ac7-6f9a-4c84-9a3b-0b764c0cece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Flow 'volume_create_manager' (085e364c-a257-47fc-bb0e-3b28e451531f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa71be3-5bbe-4fb6-adf5-efb4ac1453fd]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8697b076-6286-450a-8ebf-5ae3272c8825 tempest-GroupsTest-1149856558 None] Created volume successfully.
Jun 01 01:53:08 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680
Jun 01 01:53:08 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4e018019-5e11-454b-8334-2db0077c47d0 tempest-GroupsTest-1149856558 None] Update group completed successfully.
Jun 01 01:53:09 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 0.876s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:09 devstack sudo[97690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2
Jun 01 01:53:09 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:09 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680" returned: 0 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab 2G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:09 devstack sudo[97695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab 2G
Jun 01 01:53:09 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:09 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" returned: 0 in 0.625s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Lock "cinder-quobyte-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2" released by "delete_volume" :: held 1.543s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Created reservations ['bd802f64-c60c-4003-a3f6-6bc2c7db25d1', '06503849-8897-4666-8b7b-112f8a7a7138', '8cdbb340-67c0-4ce1-9f57-eb1fbbac2cc3', '5e1f9d88-2355-454a-abb0-c6305eaecd84'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:09 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:09 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2d29b8da-50f7-4c7e-a49f-982e9a80c94a tempest-GroupsTest-1149856558 None] Update group completed successfully.
Jun 01 01:53:10 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab 2G" returned: 0 in 0.963s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e42fde-bb44-4962-8969-fe181add4680 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:10 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e42fde-bb44-4962-8969-fe181add4680 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab
Jun 01 01:53:10 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:10 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Deleted volume successfully.
Jun 01 01:53:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bd3efa3c-aba9-4bca-92dc-0352522b1b94 tempest-VolumesActionsTest-459592884 None] Lock "cinder-7cd65b51-8c6b-4b91-84de-7c8d0feb8ed2-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:11 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e42fde-bb44-4962-8969-fe181add4680 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" returned: 0 in 0.740s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:11 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab is being set with open permissions: ugo+rw
Jun 01 01:53:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:11 devstack sudo[97711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab
Jun 01 01:53:11 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:11 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" returned: 0 in 0.651s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:11 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.info
Jun 01 01:53:11 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Acquiring lock "cinder-quobyte-80294d2c-42b9-42d6-a8fa-4aa1a082d40c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Lock "cinder-quobyte-80294d2c-42b9-42d6-a8fa-4aa1a082d40c" acquired by "delete_volume" :: waited 0.059s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[998fc9d8-36b0-4445-81a9-4c64b3bc5c47]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:12 devstack sudo[97717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c
Jun 01 01:53:12 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:12 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.info" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:12 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.info is being set with open permissions: ugo+rw
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:12 devstack sudo[97744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.info
Jun 01 01:53:12 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:12 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c" returned: 0 in 0.838s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:13 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c
Jun 01 01:53:13 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:13 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.info" returned: 0 in 0.832s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.064s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-46a6940a-3478-44da-88d5-fcd6370b9d53 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Create snapshot completed successfully
Jun 01 01:53:13 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-80294d2c-42b9-42d6-a8fa-4aa1a082d40c" returned: 0 in 1.004s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Lock "cinder-quobyte-80294d2c-42b9-42d6-a8fa-4aa1a082d40c" released by "delete_volume" :: held 1.912s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Acquiring lock "cinder-quobyte-b3718689-0b0d-4996-84ff-2bf049831b36" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Lock "cinder-quobyte-b3718689-0b0d-4996-84ff-2bf049831b36" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5b5df5-9493-4e79-8ef7-44a30db341a6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:14 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36
Jun 01 01:53:14 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "cinder-e8bb6dc6-8e60-4653-bc52-6527ff5e21ab-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-e8bb6dc6-8e60-4653-bc52-6527ff5e21ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "cinder-quobyte-20e42fde-bb44-4962-8969-fe181add4680" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-quobyte-20e42fde-bb44-4962-8969-fe181add4680" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "cinder-quobyte-e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-quobyte-e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Deleting offline snapshot e8bb6dc6-8e60-4653-bc52-6527ff5e21ab of volume 20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] snapshot_file for this snap is: volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[994cad46-46e0-42b0-a19f-86988190e7f8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:14 devstack sudo[97826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab
Jun 01 01:53:14 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:15 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36" returned: 0 in 1.095s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:15 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36
Jun 01 01:53:15 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:15 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" returned: 0 in 0.974s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20e42fde-bb44-4962-8969-fe181add4680(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44fe60c-9bed-4724-b25c-54322cb8caac]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:15 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680
Jun 01 01:53:15 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:15 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b3718689-0b0d-4996-84ff-2bf049831b36" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Lock "cinder-quobyte-b3718689-0b0d-4996-84ff-2bf049831b36" released by "delete_volume" :: held 1.870s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Created reservations ['b8092520-d0a8-42d2-bc6f-62871bfb06d6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:15 devstack cinder-volume[86676]: WARNING cinder.quota [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1368985719 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1368985719, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:53:15 devstack cinder-volume[86676]: WARNING cinder.quota [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1368985719 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1368985719, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:53:15 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Created reservations ['f64d5a72-af1e-4d89-85e6-5f9f42e32ac3', '848d0113-945e-4475-872f-e3f1f79ef1a7', '2bf20f8c-8bfb-4a92-9952-760e945934b5', '4298001a-2b63-4c1b-a434-6fa620cc9908'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Created reservations ['f5009a26-aeb0-4ce7-9ffa-682022e0f134', '0d1ee6fc-3545-4de9-b76d-4ad38deba3cb', '13f5cb74-d332-4b95-a119-56aa1b9f805f', '13ad44fe-3824-492b-ae83-c2e5b192920c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:16 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:16 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:16 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:16 devstack sudo[97846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab
Jun 01 01:53:16 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:16 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5f61ef1e-991b-41c8-a6a7-ab7a3771b81c tempest-GroupsTest-1149856558 None] Delete group completed successfully.
Jun 01 01:53:17 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" returned: 0 in 0.785s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:17 devstack sudo[97852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab
Jun 01 01:53:17 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (d64b6a38-264e-46a4-8a2d-4bd46aeabbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdd11f6-082f-44a3-b134-72fb8d3ddedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdd11f6-082f-44a3-b134-72fb8d3ddedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-265479506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4427746-65a0-4a30-bb07-d82e0590d985,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:17Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee59efdd-7171-4df5-8322-5833425c8f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee59efdd-7171-4df5-8322-5833425c8f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa18b2ee-eaed-48e5-83b7-3312b61a6df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa18b2ee-eaed-48e5-83b7-3312b61a6df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4427746-65a0-4a30-bb07-d82e0590d985', 'volume_name': 'volume-a4427746-65a0-4a30-bb07-d82e0590d985', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce733a5-6198-445e-b9d1-0d0d2c2d8f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce733a5-6198-445e-b9d1-0d0d2c2d8f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ce948-26a5-42f3-876c-1711663a1107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Volume a4427746-65a0-4a30-bb07-d82e0590d985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4427746-65a0-4a30-bb07-d82e0590d985', 'volume_size': 1}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-265479506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4427746-65a0-4a30-bb07-d82e0590d985,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:17Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Creating volume a4427746-65a0-4a30-bb07-d82e0590d985 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:53:17 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:17 devstack sudo[97854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985 1073741824
Jun 01 01:53:17 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:17 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680.e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" returned: 0 in 0.676s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-quobyte-e8bb6dc6-8e60-4653-bc52-6527ff5e21ab" released by "_delete_snapshot" :: held 3.422s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-quobyte-20e42fde-bb44-4962-8969-fe181add4680" released by "delete_snapshot" :: held 3.448s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Created reservations ['d2fdc9c6-5453-494f-a316-a3b36461a1e2', 'e3c3c536-bb70-4242-8d24-7c4ff3397cff', 'b311e098-44b0-4e73-9898-a081cdbd6ce9', 'be804fd7-4fd1-456a-9315-590a114c97cd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Delete snapshot completed successfully.
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bfff38e0-31f2-41db-9d76-c8c4afd4e7b1 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-e8bb6dc6-8e60-4653-bc52-6527ff5e21ab-delete_snapshot" released by "delete_snapshot" :: held 3.596s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:18 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985 1073741824" returned: 0 in 0.862s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:18 devstack sudo[97861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985
Jun 01 01:53:18 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "cinder-20e42fde-bb44-4962-8969-fe181add4680-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-20e42fde-bb44-4962-8969-fe181add4680-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "cinder-quobyte-20e42fde-bb44-4962-8969-fe181add4680" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-quobyte-20e42fde-bb44-4962-8969-fe181add4680" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f5e53-9850-49af-9aee-8a60d2ecbd6a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:19 devstack sudo[97863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680
Jun 01 01:53:19 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:19 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985" returned: 0 in 0.727s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ce948-26a5-42f3-876c-1711663a1107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4427746-65a0-4a30-bb07-d82e0590d985', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d4e9d5-398f-41af-a354-caf84bf2268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Volume volume-a4427746-65a0-4a30-bb07-d82e0590d985 (a4427746-65a0-4a30-bb07-d82e0590d985): created successfully
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d4e9d5-398f-41af-a354-caf84bf2268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (d64b6a38-264e-46a4-8a2d-4bd46aeabbff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0007db25-0646-4d7c-b563-4608117ec05a tempest-VolumesGetTest-965954459 None] Created volume successfully.
Jun 01 01:53:19 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:19 devstack sudo[97869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680
Jun 01 01:53:19 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (c451383d-49a6-4e30-90ef-f15ffdc9dbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bd9f11-f1c5-486b-a0d2-a9bc57f0a741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:20 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bd9f11-f1c5-486b-a0d2-a9bc57f0a741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-717496749',display_name='tempest-VolumesGetTest-Volume-1914160551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7724c5f5-4519-43d8-a480-dc58d4b13f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:20Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5111dece-99a4-43e0-8009-f3bdccaed7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5111dece-99a4-43e0-8009-f3bdccaed7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd99f4ba-1c2e-4167-a574-df47748d5f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd99f4ba-1c2e-4167-a574-df47748d5f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7724c5f5-4519-43d8-a480-dc58d4b13f64', 'volume_name': 'volume-7724c5f5-4519-43d8-a480-dc58d4b13f64', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e872b329-9c0c-459c-b496-9fac4ec5a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e872b329-9c0c-459c-b496-9fac4ec5a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d82dcd8-7623-481a-b6eb-dd36d52ed6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Volume 7724c5f5-4519-43d8-a480-dc58d4b13f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7724c5f5-4519-43d8-a480-dc58d4b13f64', 'volume_size': 1}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-717496749',display_name='tempest-VolumesGetTest-Volume-1914160551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7724c5f5-4519-43d8-a480-dc58d4b13f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:20Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Creating volume 7724c5f5-4519-43d8-a480-dc58d4b13f64 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:53:20 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-20e42fde-bb44-4962-8969-fe181add4680" returned: 0 in 0.743s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:20 devstack sudo[97872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64 1073741824
Jun 01 01:53:20 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-quobyte-20e42fde-bb44-4962-8969-fe181add4680" released by "delete_volume" :: held 1.591s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Created reservations ['ac161b38-121c-42c2-8fdd-2fd00bf923be', '66c23d33-c55e-49a2-b2af-e835fc54fa6f', '7adee5ff-0374-41d4-8a6c-064dde08056c', 'cd2ba896-d77a-43f3-9f55-6a22a4aeafc8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:20 devstack sudo[97874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:20 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:21 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64 1073741824" returned: 0 in 0.854s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:21 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.712s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Deleted volume successfully.
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-569e6e02-e270-4b52-b20f-8aa41c963a98 tempest-VolumesSnapshotNegativeTestJSON-853015490 None] Lock "cinder-20e42fde-bb44-4962-8969-fe181add4680-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:21 devstack sudo[97882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64
Jun 01 01:53:21 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:21 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:53:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d82dcd8-7623-481a-b6eb-dd36d52ed6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7724c5f5-4519-43d8-a480-dc58d4b13f64', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b240c19-7ad3-4e55-a632-3017c19ab48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Volume volume-7724c5f5-4519-43d8-a480-dc58d4b13f64 (7724c5f5-4519-43d8-a480-dc58d4b13f64): created successfully
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b240c19-7ad3-4e55-a632-3017c19ab48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (c451383d-49a6-4e30-90ef-f15ffdc9dbb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-022d351e-9509-494d-8efb-79f38135a898 tempest-VolumesGetTest-965954459 None] Created volume successfully.
Jun 01 01:53:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-60a0b04a-2425-422d-8eb7-a22167f881b4 tempest-GroupsV314Test-466604037 None] Group tempest-GroupsV314Test-Group-1106076716: creating
Jun 01 01:53:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-60a0b04a-2425-422d-8eb7-a22167f881b4 tempest-GroupsV314Test-466604037 None] Group tempest-GroupsV314Test-Group-1106076716: created successfully
Jun 01 01:53:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-60a0b04a-2425-422d-8eb7-a22167f881b4 tempest-GroupsV314Test-466604037 None] Create group completed successfully.
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-7724c5f5-4519-43d8-a480-dc58d4b13f64-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Lock "cinder-7724c5f5-4519-43d8-a480-dc58d4b13f64-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-7724c5f5-4519-43d8-a480-dc58d4b13f64" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-7724c5f5-4519-43d8-a480-dc58d4b13f64" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9982ff80-e1e4-424d-8dc6-fc735635557e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:22 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64
Jun 01 01:53:22 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:23 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64" returned: 0 in 0.793s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:23 devstack sudo[97890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64
Jun 01 01:53:23 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:23 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Flow 'volume_create_manager' (a5bcfa52-6e08-450b-ac37-09ecb481e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45ede0f-a070-4d6c-9b71-0414e2a16d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45ede0f-a070-4d6c-9b71-0414e2a16d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663795770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9269ce01-e493-4e19-a1ef-9ef91f279447,host='devstack@QuobyteHD#QuobyteHD',id=e59323bd-30f1-4eac-b9be-840bc3a97564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b258f191c7045d79db4244bebd64cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:24Z,use_quota=True,user_id='b0bda35211a14fb5b0f60bd0814695c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e9ce6f-e236-4bb0-b5b2-301462ae9749),volume_type_id=02e9ce6f-e236-4bb0-b5b2-301462ae9749)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20be863e-d312-4659-9117-16f54b423806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20be863e-d312-4659-9117-16f54b423806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaca633-bb92-4435-aae7-5c7e7344dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaca633-bb92-4435-aae7-5c7e7344dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59323bd-30f1-4eac-b9be-840bc3a97564', 'volume_name': 'volume-e59323bd-30f1-4eac-b9be-840bc3a97564', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b487aaa7-f2d7-444b-956f-7d6d01514358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b487aaa7-f2d7-444b-956f-7d6d01514358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54176021-1a7d-4ced-85d2-4912d3560dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Volume e59323bd-30f1-4eac-b9be-840bc3a97564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59323bd-30f1-4eac-b9be-840bc3a97564', 'volume_size': 1}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9269ce01-e493-4e19-a1ef-9ef91f279447,created_at=2026-05-31T23:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663795770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9269ce01-e493-4e19-a1ef-9ef91f279447,host='devstack@QuobyteHD#QuobyteHD',id=e59323bd-30f1-4eac-b9be-840bc3a97564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b258f191c7045d79db4244bebd64cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:24Z,use_quota=True,user_id='b0bda35211a14fb5b0f60bd0814695c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e9ce6f-e236-4bb0-b5b2-301462ae9749),volume_type_id=02e9ce6f-e236-4bb0-b5b2-301462ae9749)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Creating volume e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:53:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:24 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 1073741824
Jun 01 01:53:24 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:24 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7724c5f5-4519-43d8-a480-dc58d4b13f64" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-7724c5f5-4519-43d8-a480-dc58d4b13f64" released by "delete_volume" :: held 1.678s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Created reservations ['6b41cc9c-d6e5-46b9-9159-9eb49c1747b6', 'a86e336c-2d52-400b-8096-a624c36ce257', '70c54543-ed43-4491-a5da-b1cf54f56420', '8429553c-1b9e-4b0b-9c6a-eef7ad57687e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:24 devstack sudo[97895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:24 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:25 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 1073741824" returned: 0 in 1.051s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-a4427746-65a0-4a30-bb07-d82e0590d985-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Lock "cinder-a4427746-65a0-4a30-bb07-d82e0590d985-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:25 devstack sudo[97901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564
Jun 01 01:53:25 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-a4427746-65a0-4a30-bb07-d82e0590d985" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-a4427746-65a0-4a30-bb07-d82e0590d985" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc2176-840e-43cd-a166-cfa0f6656a0b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:25 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985
Jun 01 01:53:25 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:25 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.086s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Deleted volume successfully.
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0be4faee-6630-4589-b4e0-bbc5b7f1b585 tempest-VolumesGetTest-965954459 None] Lock "cinder-7724c5f5-4519-43d8-a480-dc58d4b13f64-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:25 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54176021-1a7d-4ced-85d2-4912d3560dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59323bd-30f1-4eac-b9be-840bc3a97564', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b30c8-68e4-44ae-a4df-510d1e04c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Volume volume-e59323bd-30f1-4eac-b9be-840bc3a97564 (e59323bd-30f1-4eac-b9be-840bc3a97564): created successfully
Jun 01 01:53:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b30c8-68e4-44ae-a4df-510d1e04c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Flow 'volume_create_manager' (a5bcfa52-6e08-450b-ac37-09ecb481e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-387867b2-e0e7-49ec-a068-af11f83d5f70 tempest-GroupsV314Test-466604037 None] Created volume successfully.
Jun 01 01:53:26 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985" returned: 0 in 0.869s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:26 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985
Jun 01 01:53:26 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:26 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a4427746-65a0-4a30-bb07-d82e0590d985" returned: 0 in 0.632s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-a4427746-65a0-4a30-bb07-d82e0590d985" released by "delete_volume" :: held 1.566s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:26 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Created reservations ['b4c3f6cd-148d-4ec8-8f0d-bc5d8b246096', '491c59d6-71b9-4224-93e9-bd3a1bd39e07', 'a3f64827-aa9b-4776-8237-ee1ff04c333a', 'af51cfb1-3fea-4f6c-9bce-6182948728f6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:27 devstack sudo[97917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:27 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:27 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Cloning volume e59323bd-30f1-4eac-b9be-840bc3a97564 to volume 1dc0a8c3-0763-4e53-b76b-926ce23aa998
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Creating offline snapshot 62392001-779e-40ce-9f70-8e39e16fb5cd of volume e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d60f4c6-13b1-4540-b8e0-68ddd6de7125]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:27 devstack sudo[97919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564
Jun 01 01:53:27 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:27 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Deleted volume successfully.
Jun 01 01:53:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c4b23fee-590b-42d8-8e90-1eba28f3e2df tempest-VolumesGetTest-965954459 None] Lock "cinder-a4427746-65a0-4a30-bb07-d82e0590d985-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (e8c968b7-6f34-4c6a-ae94-9b4d0561c0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9495933c-11f9-472a-bc46-79bd7443e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9495933c-11f9-472a-bc46-79bd7443e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1493498082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39615ed-797f-43e6-aea6-c22b944230a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:28Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f596a3-d453-4bf2-8342-1d88fa420f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f596a3-d453-4bf2-8342-1d88fa420f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8bc92a-2c47-4d86-8c42-d5a2b34d0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8bc92a-2c47-4d86-8c42-d5a2b34d0477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39615ed-797f-43e6-aea6-c22b944230a6', 'volume_name': 'volume-c39615ed-797f-43e6-aea6-c22b944230a6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f83461-b89a-4357-b553-310aa38fdcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f83461-b89a-4357-b553-310aa38fdcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2376547-63e0-43a0-81c9-6c64ac5d32ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Volume c39615ed-797f-43e6-aea6-c22b944230a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39615ed-797f-43e6-aea6-c22b944230a6', 'volume_size': 1}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:28 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564" returned: 0 in 0.853s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:28 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd 1G
Jun 01 01:53:28 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:28 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd 1G" returned: 0 in 0.779s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59323bd-30f1-4eac-b9be-840bc3a97564 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:29 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59323bd-30f1-4eac-b9be-840bc3a97564 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd
Jun 01 01:53:29 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:29 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59323bd-30f1-4eac-b9be-840bc3a97564 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd" returned: 0 in 0.990s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:29 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:53:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:30 devstack sudo[97945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd
Jun 01 01:53:30 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-2b9efb58-0a1f-4ebc-8289-55e0316f4745 req-0fdbfb25-79d4-4b18-aa2c-b6751d4f5e3d tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:30 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd" returned: 0 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:30 devstack sudo[97950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.info
Jun 01 01:53:30 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:31 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.info" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:31 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:53:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:31 devstack sudo[97953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.info
Jun 01 01:53:31 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:32 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.info" returned: 0 in 0.841s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Acquiring lock "cinder-quobyte-1dc0a8c3-0763-4e53-b76b-926ce23aa998" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-1dc0a8c3-0763-4e53-b76b-926ce23aa998" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] snapshot: 62392001-779e-40ce-9f70-8e39e16fb5cd, volume: 1dc0a8c3-0763-4e53-b76b-926ce23aa998,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bbc65b-0ec6-450d-a4e7-09e2dcf817d4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:32 devstack sudo[97956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd
Jun 01 01:53:32 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:33 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59323bd-30f1-4eac-b9be-840bc3a97564(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1b37f3-fa07-4a46-8c03-32056ba181a8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:33 devstack sudo[97961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564
Jun 01 01:53:33 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:33 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564" returned: 0 in 0.741s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:53:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:34 devstack sudo[97966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998
Jun 01 01:53:34 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:39 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998" returned: 0 in 5.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b38778f-2792-475d-9e6e-3e4c04732b43]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:39 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564
Jun 01 01:53:39 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:40 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564" returned: 0 in 0.946s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:40 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:53:40 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Converted 1024.00 MB image at 178.51 MB/s
Jun 01 01:53:40 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998 is being set with open permissions: ugo+rw: NotImplementedError
Jun 01 01:53:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:40 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998
Jun 01 01:53:40 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=80,cinder:UPDATE=68,cinder:DELETE=6,cinder:INSERT=20 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:53:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=66,cinder:UPDATE=94,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:53:41 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-1dc0a8c3-0763-4e53-b76b-926ce23aa998" released by "_copy_volume_from_snapshot" :: held 9.005s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Acquiring lock "cinder-quobyte-62392001-779e-40ce-9f70-8e39e16fb5cd" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-62392001-779e-40ce-9f70-8e39e16fb5cd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Deleting offline snapshot 62392001-779e-40ce-9f70-8e39e16fb5cd of volume e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] snapshot_file for this snap is: volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e4003b-e8ea-4a06-8464-f0e1c5562235]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:41 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd
Jun 01 01:53:41 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:42 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd" returned: 0 in 0.740s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59323bd-30f1-4eac-b9be-840bc3a97564(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:53:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c33e39c-29bc-4595-b5a3-f4301ea2c906]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:42 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564
Jun 01 01:53:42 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:42 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:42 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd
Jun 01 01:53:42 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:43 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd" returned: 0 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:43 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd
Jun 01 01:53:43 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:44 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564.62392001-779e-40ce-9f70-8e39e16fb5cd" returned: 0 in 0.613s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-62392001-779e-40ce-9f70-8e39e16fb5cd" released by "_delete_snapshot" :: held 2.961s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.072s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.226s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1493498082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39615ed-797f-43e6-aea6-c22b944230a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:28Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Creating volume c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:53:44 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:53:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:44 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 1073741824
Jun 01 01:53:44 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-58484b54-312b-429d-afdd-5bddf6c46d0d tempest-GroupsV314Test-466604037 None] Create group from source-group-9269ce01-e493-4e19-a1ef-9ef91f279447 completed successfully.
Jun 01 01:53:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Acquiring lock "cinder-quobyte-1dc0a8c3-0763-4e53-b76b-926ce23aa998" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-1dc0a8c3-0763-4e53-b76b-926ce23aa998" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a1bb48-3f10-4dee-8108-ae03e7349099]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:45 devstack sudo[98014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998
Jun 01 01:53:45 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:45 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 1073741824" returned: 0 in 1.052s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:45 devstack sudo[98016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6
Jun 01 01:53:45 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:46 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998" returned: 0 in 0.947s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:46 devstack sudo[98023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998
Jun 01 01:53:46 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:46 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6" returned: 0 in 0.703s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-2b9efb58-0a1f-4ebc-8289-55e0316f4745 req-0fdbfb25-79d4-4b18-aa2c-b6751d4f5e3d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.023s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2376547-63e0-43a0-81c9-6c64ac5d32ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39615ed-797f-43e6-aea6-c22b944230a6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab71ef38-5d1a-420c-8fe2-1202dc38d1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b816308e-e2b4-4563-bfa5-4b001c34c2aa]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-2b9efb58-0a1f-4ebc-8289-55e0316f4745 req-0fdbfb25-79d4-4b18-aa2c-b6751d4f5e3d tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Volume volume-c39615ed-797f-43e6-aea6-c22b944230a6 (c39615ed-797f-43e6-aea6-c22b944230a6): created successfully
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab71ef38-5d1a-420c-8fe2-1202dc38d1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (e8c968b7-6f34-4c6a-ae94-9b4d0561c0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fa92dfd2-1ec9-42ad-9409-959215cd8ba4 tempest-VolumesGetTest-965954459 None] Created volume successfully.
Jun 01 01:53:46 devstack sudo[98025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455
Jun 01 01:53:46 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:46 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1dc0a8c3-0763-4e53-b76b-926ce23aa998" returned: 0 in 0.676s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-1dc0a8c3-0763-4e53-b76b-926ce23aa998" released by "delete_volume" :: held 1.709s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:46 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Created reservations ['8dd29d22-811b-49ef-a7f0-5a0894ca0523'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:47 devstack cinder-volume[86676]: WARNING cinder.quota [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1778792511 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1778792511, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:53:47 devstack cinder-volume[86676]: WARNING cinder.quota [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1778792511 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1778792511, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Created reservations ['dcb95b47-bbce-4cb8-8d67-e5aef3e2eb79', 'e1813b33-a678-488e-bce5-7926935e96ba', '9958ea97-779b-449f-a3fd-293526844ed7', '763eb2b5-3c84-442c-8002-dff94ceaa685'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:47 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-2b9efb58-0a1f-4ebc-8289-55e0316f4745 req-0fdbfb25-79d4-4b18-aa2c-b6751d4f5e3d tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455" returned: 0 in 0.982s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-2b9efb58-0a1f-4ebc-8289-55e0316f4745 req-0fdbfb25-79d4-4b18-aa2c-b6751d4f5e3d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.032s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:47 devstack sudo[98032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:47 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-2b9efb58-0a1f-4ebc-8289-55e0316f4745 req-0fdbfb25-79d4-4b18-aa2c-b6751d4f5e3d tempest-TestInstancesWithCinderVolumes-1318012948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-fe837ef0-6a30-48ec-9f66-666884a41455', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f8655be-f45e-4565-b22b-08e3bf408833', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:53:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-2b9efb58-0a1f-4ebc-8289-55e0316f4745 req-0fdbfb25-79d4-4b18-aa2c-b6751d4f5e3d tempest-TestInstancesWithCinderVolumes-1318012948 None] attachment_update completed successfully.
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (a81657d1-b596-4ee4-b30f-b3dc522d8225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e290ef16-a28d-40c8-8eeb-6bf087b3e0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e290ef16-a28d-40c8-8eeb-6bf087b3e0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1521798205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335288f8-9558-4bd6-a4b8-902e7cf54746,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c39615ed-797f-43e6-aea6-c22b944230a6,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:48Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92801c60-7818-4f25-b4d8-73668dfaf6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92801c60-7818-4f25-b4d8-73668dfaf6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b02f848-2835-42d7-989f-5b661e7037cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b02f848-2835-42d7-989f-5b661e7037cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '335288f8-9558-4bd6-a4b8-902e7cf54746', 'volume_name': 'volume-335288f8-9558-4bd6-a4b8-902e7cf54746', 'volume_size': 1, 'source_volid': 'c39615ed-797f-43e6-aea6-c22b944230a6', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9023b4d2-a540-48d5-9a30-af5cea4a0d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9023b4d2-a540-48d5-9a30-af5cea4a0d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e7eeee-0446-4cb6-ad93-738a1674afad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Volume 335288f8-9558-4bd6-a4b8-902e7cf54746: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-335288f8-9558-4bd6-a4b8-902e7cf54746', 'volume_size': 1, 'source_volid': 'c39615ed-797f-43e6-aea6-c22b944230a6', 'source_volstatus': 'available'}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Cloning volume c39615ed-797f-43e6-aea6-c22b944230a6 to volume 335288f8-9558-4bd6-a4b8-902e7cf54746
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Creating offline snapshot c7b0b00f-4b16-4bfb-9958-ff485270e572 of volume c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3b6c3-b919-45e7-851d-6f35a292dacc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:48 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.934s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5ef1b1a0-40d8-4077-9c7f-180a9241f56b tempest-GroupsV314Test-466604037 None] Delete group completed successfully.
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Acquiring lock "cinder-quobyte-e59323bd-30f1-4eac-b9be-840bc3a97564" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-e59323bd-30f1-4eac-b9be-840bc3a97564" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:48 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6
Jun 01 01:53:48 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0cafa-6902-4ce0-ab41-287f5d3e21a5]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:48 devstack sudo[98038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564
Jun 01 01:53:48 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:49 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6" returned: 0 in 1.083s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:49 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564" returned: 0 in 0.921s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:49 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 1G
Jun 01 01:53:49 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:49 devstack sudo[98086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564
Jun 01 01:53:49 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:49 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e59323bd-30f1-4eac-b9be-840bc3a97564" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Lock "cinder-quobyte-e59323bd-30f1-4eac-b9be-840bc3a97564" released by "delete_volume" :: held 1.770s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:53:50 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 1G" returned: 0 in 0.862s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c39615ed-797f-43e6-aea6-c22b944230a6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:50 devstack sudo[98092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c39615ed-797f-43e6-aea6-c22b944230a6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572
Jun 01 01:53:50 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Created reservations ['c8766fc1-281a-4770-a3cb-f4d658982c56'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Created reservations ['bd226bbd-64fe-4adc-ad3b-b01f30fecfd3', '56f6bbd3-2cc8-4255-ac68-e861ca26bbd1', 'e62fcaf8-4088-4d6b-9a6b-6661d7ec6329', '76133dd8-55af-4662-b0cd-41a1919de152'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:50 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:50 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:50 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c39615ed-797f-43e6-aea6-c22b944230a6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572" returned: 0 in 0.763s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:50 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 is being set with open permissions: ugo+rw
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:50 devstack sudo[98103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572
Jun 01 01:53:50 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:50 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-24b34047-bf74-4f18-9506-a4eb6b750328 tempest-GroupsV314Test-466604037 None] Delete group completed successfully.
Jun 01 01:53:51 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572" returned: 0 in 0.699s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:51 devstack sudo[98107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.info
Jun 01 01:53:51 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Flow 'volume_create_manager' (79cba45e-7977-4fe8-afcf-c2c06079803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65284b75-567b-4c44-acd7-2e535f71af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65284b75-567b-4c44-acd7-2e535f71af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1595492296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644bab3c-978d-4724-82c0-60662850bbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49975cd06e0745e1bef81ae35d829d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:52Z,use_quota=True,user_id='dce623c153fd46288f63576e0a2a1bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0f9588-7712-4397-8d0d-7e96392568ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0f9588-7712-4397-8d0d-7e96392568ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b63be3-f03d-485b-bf0e-cdb3bdf62093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b63be3-f03d-485b-bf0e-cdb3bdf62093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '644bab3c-978d-4724-82c0-60662850bbf0', 'volume_name': 'volume-644bab3c-978d-4724-82c0-60662850bbf0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc6088-5c4e-4424-883b-f884a030d888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc6088-5c4e-4424-883b-f884a030d888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a734eb98-cfd7-4bc6-9a4b-22134b8fab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:53:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Volume 644bab3c-978d-4724-82c0-60662850bbf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-644bab3c-978d-4724-82c0-60662850bbf0', 'volume_size': 1}
Jun 01 01:53:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:52 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.info" returned: 0 in 0.819s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:52 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.info is being set with open permissions: ugo+rw
Jun 01 01:53:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:52 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:53:52 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:52 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.info
Jun 01 01:53:52 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:53 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:53:53 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.info" returned: 0 in 0.935s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-335288f8-9558-4bd6-a4b8-902e7cf54746" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-335288f8-9558-4bd6-a4b8-902e7cf54746" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] snapshot: c7b0b00f-4b16-4bfb-9958-ff485270e572, volume: 335288f8-9558-4bd6-a4b8-902e7cf54746,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44db1bf-9090-43f3-aaaf-f25607bace3c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:53 devstack sudo[98125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572
Jun 01 01:53:53 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:54 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572" returned: 0 in 0.730s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c39615ed-797f-43e6-aea6-c22b944230a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:53:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:53:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:53:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[472c1136-96fd-4c73-a8d2-a11649f95c8b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:53:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:54 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6
Jun 01 01:53:54 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:55 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Jun 01 01:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6" returned: 0 in 0.855s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:53:55 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:53:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:53:55 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746
Jun 01 01:53:55 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:53:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-833e9894-9ac0-45e4-b5bc-5e50e6d209b3 req-c380657d-c302-45e7-96d4-a8c26e789338 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:53:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ec2e8efc-3bc0-4951-978c-b2631a8cf9e8 tempest-GroupsV320Test-2125941507 None] Group tempest-GroupsV320Test-Group-1847886753: creating
Jun 01 01:53:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ec2e8efc-3bc0-4951-978c-b2631a8cf9e8 tempest-GroupsV320Test-2125941507 None] Group tempest-GroupsV320Test-Group-1847886753: created successfully
Jun 01 01:53:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ec2e8efc-3bc0-4951-978c-b2631a8cf9e8 tempest-GroupsV320Test-2125941507 None] Create group completed successfully.
Jun 01 01:54:00 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Created reservations ['fc3d5cb6-0987-4d43-8464-0769f4d14fb7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:00 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:00 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:01 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746" returned: 0 in 6.039s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9f7fe-6963-4d2a-b277-7fce304ff06d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:01 devstack sudo[98181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6
Jun 01 01:54:01 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:01 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:01 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-27a0d6c4-64f1-4dfa-a69f-e0fc87016f47 tempest-GroupsV320Test-2125941507 None] Delete group completed successfully.
Jun 01 01:54:02 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6" returned: 0 in 1.011s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:54:02 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Converted 1024.00 MB image at 169.50 MB/s
Jun 01 01:54:02 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746 is being set with open permissions: ugo+rw
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:02 devstack sudo[98192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746
Jun 01 01:54:02 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:02 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-335288f8-9558-4bd6-a4b8-902e7cf54746" released by "_copy_volume_from_snapshot" :: held 9.389s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-c7b0b00f-4b16-4bfb-9958-ff485270e572" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-c7b0b00f-4b16-4bfb-9958-ff485270e572" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Deleting offline snapshot c7b0b00f-4b16-4bfb-9958-ff485270e572 of volume c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] snapshot_file for this snap is: volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[688208d7-cbe4-4bda-9f7d-27177e959e39]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:02 devstack sudo[98195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572
Jun 01 01:54:02 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:03 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572" returned: 0 in 0.822s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c39615ed-797f-43e6-aea6-c22b944230a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:54:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb9b050-2dcb-4a93-99bc-f1a58219b387]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:03 devstack sudo[98200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6
Jun 01 01:54:03 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:04 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:04 devstack sudo[98205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572
Jun 01 01:54:04 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:05 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:05 devstack sudo[98211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572
Jun 01 01:54:05 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:05 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6.c7b0b00f-4b16-4bfb-9958-ff485270e572" returned: 0 in 0.641s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-c7b0b00f-4b16-4bfb-9958-ff485270e572" released by "_delete_snapshot" :: held 3.136s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.999s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.225s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1595492296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644bab3c-978d-4724-82c0-60662850bbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49975cd06e0745e1bef81ae35d829d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:53:52Z,use_quota=True,user_id='dce623c153fd46288f63576e0a2a1bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Creating volume 644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:05 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:06 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 1073741824
Jun 01 01:54:06 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e7eeee-0446-4cb6-ad93-738a1674afad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335288f8-9558-4bd6-a4b8-902e7cf54746', 'volume_size': 1, 'source_volid': 'c39615ed-797f-43e6-aea6-c22b944230a6', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50e1aae-c149-4fa0-bf47-5d8f0dceba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:06 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Volume volume-335288f8-9558-4bd6-a4b8-902e7cf54746 (335288f8-9558-4bd6-a4b8-902e7cf54746): created successfully
Jun 01 01:54:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50e1aae-c149-4fa0-bf47-5d8f0dceba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:06 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (a81657d1-b596-4ee4-b30f-b3dc522d8225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-28688b73-04d0-43ac-b008-800e1723b4aa tempest-VolumesGetTest-965954459 None] Created volume successfully.
Jun 01 01:54:06 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 1073741824" returned: 0 in 0.912s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:06 devstack sudo[98223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:54:06 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (865ad0f7-aed7-4ec5-9aaa-7f2a524c8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e188095-89fb-4455-822c-d3ff152e194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e188095-89fb-4455-822c-d3ff152e194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1732374113',display_name='tempest-VolumesGetTest-Volume-403671824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9f7871-13ad-469b-9ea1-764f38d9b718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:08Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efabe80-6fac-4381-a52d-2a85a06fb88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efabe80-6fac-4381-a52d-2a85a06fb88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff264e90-d5b6-43b5-85f3-9ead64cbc792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff264e90-d5b6-43b5-85f3-9ead64cbc792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9f7871-13ad-469b-9ea1-764f38d9b718', 'volume_name': 'volume-dc9f7871-13ad-469b-9ea1-764f38d9b718', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd43685-73a7-4436-acb0-fafdb7ba0403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd43685-73a7-4436-acb0-fafdb7ba0403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2597f545-1f6c-44c0-a803-bda04efab5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Volume dc9f7871-13ad-469b-9ea1-764f38d9b718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9f7871-13ad-469b-9ea1-764f38d9b718', 'volume_size': 1}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:08 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 1.448s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-833e9894-9ac0-45e4-b5bc-5e50e6d209b3 req-c380657d-c302-45e7-96d4-a8c26e789338 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.044s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a734eb98-cfd7-4bc6-9a4b-22134b8fab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-644bab3c-978d-4724-82c0-60662850bbf0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b7479b-3327-45c6-8488-0cc9bb2fa375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304d04e-0338-472c-8a2c-1f114c6a7b64]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-833e9894-9ac0-45e4-b5bc-5e50e6d209b3 req-c380657d-c302-45e7-96d4-a8c26e789338 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Volume volume-644bab3c-978d-4724-82c0-60662850bbf0 (644bab3c-978d-4724-82c0-60662850bbf0): created successfully
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b7479b-3327-45c6-8488-0cc9bb2fa375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Flow 'volume_create_manager' (79cba45e-7977-4fe8-afcf-c2c06079803e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5b45c52a-1d3f-4743-a706-4ed4c2aec68d tempest-TestStampPattern-2091375347 None] Created volume successfully.
Jun 01 01:54:08 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3
Jun 01 01:54:08 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:09 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-833e9894-9ac0-45e4-b5bc-5e50e6d209b3 req-c380657d-c302-45e7-96d4-a8c26e789338 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3" returned: 0 in 0.999s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-833e9894-9ac0-45e4-b5bc-5e50e6d209b3 req-c380657d-c302-45e7-96d4-a8c26e789338 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.269s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1732374113',display_name='tempest-VolumesGetTest-Volume-403671824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9f7871-13ad-469b-9ea1-764f38d9b718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:08Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Creating volume dc9f7871-13ad-469b-9ea1-764f38d9b718 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:09 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:09 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718 1073741824
Jun 01 01:54:09 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-833e9894-9ac0-45e4-b5bc-5e50e6d209b3 req-c380657d-c302-45e7-96d4-a8c26e789338 tempest-TestInstancesWithCinderVolumes-1318012948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-cf145984-ad45-41a9-a1cc-404e932d24d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '815082fb-27c5-4c01-96da-e399ec15ad7e', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:54:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-833e9894-9ac0-45e4-b5bc-5e50e6d209b3 req-c380657d-c302-45e7-96d4-a8c26e789338 tempest-TestInstancesWithCinderVolumes-1318012948 None] attachment_update completed successfully.
Jun 01 01:54:10 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718 1073741824" returned: 0 in 1.143s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:10 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718
Jun 01 01:54:10 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:11 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2597f545-1f6c-44c0-a803-bda04efab5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9f7871-13ad-469b-9ea1-764f38d9b718', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c2953d-3391-4ddf-ac09-db160f005c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Volume volume-dc9f7871-13ad-469b-9ea1-764f38d9b718 (dc9f7871-13ad-469b-9ea1-764f38d9b718): created successfully
Jun 01 01:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c2953d-3391-4ddf-ac09-db160f005c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (865ad0f7-aed7-4ec5-9aaa-7f2a524c8150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8df60600-f422-4956-b04f-8a8f7ed84f92 tempest-VolumesGetTest-965954459 None] Created volume successfully.
Jun 01 01:54:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-dc9f7871-13ad-469b-9ea1-764f38d9b718-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Lock "cinder-dc9f7871-13ad-469b-9ea1-764f38d9b718-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-dc9f7871-13ad-469b-9ea1-764f38d9b718" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-dc9f7871-13ad-469b-9ea1-764f38d9b718" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:12 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[676b8f55-8d67-4e4d-8057-b48b9ed21034]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:12 devstack sudo[98308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718
Jun 01 01:54:12 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:13 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718" returned: 0 in 0.988s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:13 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718
Jun 01 01:54:13 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:14 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-dc9f7871-13ad-469b-9ea1-764f38d9b718" returned: 0 in 0.830s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-dc9f7871-13ad-469b-9ea1-764f38d9b718" released by "delete_volume" :: held 1.915s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Created reservations ['3b8fd665-605d-4829-a76d-be4ed86c150b', 'a558f4c2-b451-482b-9ad9-27988223713a', '0ce4c63d-f7b5-4953-a67e-92c836949988', 'e7190d0c-e45b-49a1-9b18-0cbe7d1b1b7e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:14 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:14 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-335288f8-9558-4bd6-a4b8-902e7cf54746-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Lock "cinder-335288f8-9558-4bd6-a4b8-902e7cf54746-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-335288f8-9558-4bd6-a4b8-902e7cf54746" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-335288f8-9558-4bd6-a4b8-902e7cf54746" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac272bf-a51f-4413-9f23-ab63ffdb7ada]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:15 devstack sudo[98327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746
Jun 01 01:54:15 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:15 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.290s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:15 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Deleted volume successfully.
Jun 01 01:54:15 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9c5dab93-682c-4d79-9db3-79511e32f4f4 tempest-VolumesGetTest-965954459 None] Lock "cinder-dc9f7871-13ad-469b-9ea1-764f38d9b718-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:16 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Flow 'volume_create_manager' (c82d0e6d-b401-4d7f-8a1d-c4d27210a158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381ec3e8-954e-40ec-858e-7665407e4de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746" returned: 0 in 1.378s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381ec3e8-954e-40ec-858e-7665407e4de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143218313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6405c7-b1aa-4900-8ac1-f7db60698e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f74ff6cfba4eaf832239059ff0b4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:16Z,use_quota=True,user_id='ea20617884844087b6e68f0076c1174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:16 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746
Jun 01 01:54:16 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636794a8-ba0f-4643-b513-76ef5883ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636794a8-ba0f-4643-b513-76ef5883ce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69cc4e4-e37e-4129-a69b-61cb6ac822cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69cc4e4-e37e-4129-a69b-61cb6ac822cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a6405c7-b1aa-4900-8ac1-f7db60698e83', 'volume_name': 'volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af2d1a4-9e15-402c-bb78-951892d17c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af2d1a4-9e15-402c-bb78-951892d17c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33094964-d334-482c-aa56-8ace4282191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Volume 7a6405c7-b1aa-4900-8ac1-f7db60698e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83', 'volume_size': 1}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143218313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6405c7-b1aa-4900-8ac1-f7db60698e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f74ff6cfba4eaf832239059ff0b4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:16Z,use_quota=True,user_id='ea20617884844087b6e68f0076c1174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Creating volume 7a6405c7-b1aa-4900-8ac1-f7db60698e83 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:16 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:16 devstack sudo[98336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83 1073741824
Jun 01 01:54:16 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:17 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-335288f8-9558-4bd6-a4b8-902e7cf54746" returned: 0 in 0.870s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-335288f8-9558-4bd6-a4b8-902e7cf54746" released by "delete_volume" :: held 2.363s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Created reservations ['8b6dfc4b-28b1-4fd1-9c1a-4491c56f01fb', 'b958f46d-4dcd-49be-92d2-1667d6f856cf', 'f5b70624-3541-400f-a936-61bcddc1dc81', '9e969a31-fb44-4dd6-82e6-377aa869affc'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:17 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:17 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:17 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83 1073741824" returned: 0 in 1.109s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:17 devstack sudo[98353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83
Jun 01 01:54:17 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:18 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.765s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Deleted volume successfully.
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fa1bdda6-7e4c-44dc-85fc-1d57c85d3827 tempest-VolumesGetTest-965954459 None] Lock "cinder-335288f8-9558-4bd6-a4b8-902e7cf54746-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:18 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-c39615ed-797f-43e6-aea6-c22b944230a6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33094964-d334-482c-aa56-8ace4282191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9bc28a-fc56-491d-b4df-648111dc125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Lock "cinder-c39615ed-797f-43e6-aea6-c22b944230a6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Volume volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83 (7a6405c7-b1aa-4900-8ac1-f7db60698e83): created successfully
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9bc28a-fc56-491d-b4df-648111dc125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Flow 'volume_create_manager' (c82d0e6d-b401-4d7f-8a1d-c4d27210a158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ecd1ef66-ae06-4cc7-8c17-b1421b7c3b89 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Created volume successfully.
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-c39615ed-797f-43e6-aea6-c22b944230a6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-c39615ed-797f-43e6-aea6-c22b944230a6" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd13054-3993-47e4-bc59-a885c1672d9c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:18 devstack sudo[98371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6
Jun 01 01:54:18 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:19 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:19 devstack sudo[98376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6
Jun 01 01:54:19 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Acquiring lock "cinder-7a6405c7-b1aa-4900-8ac1-f7db60698e83-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "cinder-7a6405c7-b1aa-4900-8ac1-f7db60698e83-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Acquiring lock "cinder-quobyte-7a6405c7-b1aa-4900-8ac1-f7db60698e83" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "cinder-quobyte-7a6405c7-b1aa-4900-8ac1-f7db60698e83" acquired by "delete_volume" :: waited 0.039s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829ede2-182e-4770-840d-4e6b23095cc9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:19 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c39615ed-797f-43e6-aea6-c22b944230a6" returned: 0 in 0.671s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-c39615ed-797f-43e6-aea6-c22b944230a6" released by "delete_volume" :: held 1.486s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Created reservations ['2a2ecdd6-791a-4dc1-a9c3-7468aa9d2b95', 'a12af9fe-8a31-4790-a8a2-974b377483e6', '6986fff5-16dc-4911-8904-27949bade419', '2415ee93-2f78-41d7-98a8-d094e798e019'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:19 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83
Jun 01 01:54:19 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:20 devstack sudo[98382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:20 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-e1bf9c9b-3ea7-42c4-9d07-7286a73fbd32 req-bc8065d3-0608-40c8-a8df-bd7fe80076e0 tempest-TestInstancesWithCinderVolumes-1318012948 None] Terminate volume connection completed successfully.
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-e1bf9c9b-3ea7-42c4-9d07-7286a73fbd32 req-bc8065d3-0608-40c8-a8df-bd7fe80076e0 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deleting attachment 5f8655be-f45e-4565-b22b-08e3bf408833. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:54:20 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83" returned: 0 in 0.864s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:20 devstack sudo[98389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83
Jun 01 01:54:20 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:20 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Deleted volume successfully.
Jun 01 01:54:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fb5f8070-404f-4ea6-ac95-d165f08b0a77 tempest-VolumesGetTest-965954459 None] Lock "cinder-c39615ed-797f-43e6-aea6-c22b944230a6-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:21 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7a6405c7-b1aa-4900-8ac1-f7db60698e83" returned: 0 in 0.815s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "cinder-quobyte-7a6405c7-b1aa-4900-8ac1-f7db60698e83" released by "delete_volume" :: held 1.763s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (13d7f091-48a5-433a-9794-501e453765b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0f2309-399e-4333-bea2-c893967ef88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0f2309-399e-4333-bea2-c893967ef88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1744727861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c5c8fc-5a2b-4665-80a2-8108c3af9186,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:21Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447c9183-c844-4ed6-9ef3-e538140a2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447c9183-c844-4ed6-9ef3-e538140a2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5add9e26-0470-44a0-a40c-6ebcb2dbf0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Created reservations ['9ee6c817-6bab-4736-b8eb-9db96b4daca1', '8283bf79-a764-4b2f-a355-ad3afb5c37cc', '7d591a7a-d476-4213-b008-1123c712feaa', '83d64346-e925-4ded-befc-c1012fcb39e6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:21 devstack sudo[98410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:21 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5add9e26-0470-44a0-a40c-6ebcb2dbf0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5c5c8fc-5a2b-4665-80a2-8108c3af9186', 'volume_name': 'volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b131760>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b335b83-2d9e-484b-a37d-c62a357edecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b335b83-2d9e-484b-a37d-c62a357edecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779584fb-5f83-4af7-bbc6-613b07f1ac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Volume c5c5c8fc-5a2b-4665-80a2-8108c3af9186: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b131760>}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Trying to clone c5c5c8fc-5a2b-4665-80a2-8108c3af9186 from image e56da659-fc04-4789-a705-f5b7a7a6ddfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "cinder-fe837ef0-6a30-48ec-9f66-666884a41455-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-fe837ef0-6a30-48ec-9f66-666884a41455-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "cinder-quobyte-fe837ef0-6a30-48ec-9f66-666884a41455" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-quobyte-fe837ef0-6a30-48ec-9f66-666884a41455" acquired by "delete_volume" :: waited 0.042s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0347111-5152-4600-9fa1-e121fffbf316]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:22 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 01:54:22 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Image download 20.69 MB at 20.69 MB/s
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.849s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Deleted volume successfully.
Jun 01 01:54:22 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455
Jun 01 01:54:22 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ad9d95fd-90ad-4667-9e71-6b7fde1d8fd0 tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "cinder-7a6405c7-b1aa-4900-8ac1-f7db60698e83-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e586af-fd3b-4229-8a36-49b5bd12a540]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Flow 'volume_create_manager' (29364f75-4e3c-489b-8475-76e1da0b2557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a483df-a823-4147-91d7-0c7372a987ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a483df-a823-4147-91d7-0c7372a987ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1573558659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa0beff-2a34-4611-b1fa-18d55ad05f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f74ff6cfba4eaf832239059ff0b4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:23Z,use_quota=True,user_id='ea20617884844087b6e68f0076c1174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fb6a33-1865-40e8-8cd5-2d8f1e11b582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:22 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD
Jun 01 01:54:22 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fb6a33-1865-40e8-8cd5-2d8f1e11b582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39860a68-ddc5-49d2-901e-0692d6865a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39860a68-ddc5-49d2-901e-0692d6865a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa0beff-2a34-4611-b1fa-18d55ad05f89', 'volume_name': 'volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ec8c1e-7741-4357-920e-f6c7f53adf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ec8c1e-7741-4357-920e-f6c7f53adf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8879e26f-a828-4c18-b41c-92a70710376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Volume eaa0beff-2a34-4611-b1fa-18d55ad05f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89', 'volume_size': 1}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1573558659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa0beff-2a34-4611-b1fa-18d55ad05f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7f74ff6cfba4eaf832239059ff0b4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:23Z,use_quota=True,user_id='ea20617884844087b6e68f0076c1174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Creating volume eaa0beff-2a34-4611-b1fa-18d55ad05f89 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:22 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:22 devstack sudo[98422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89 1073741824
Jun 01 01:54:22 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:23 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455" returned: 0 in 0.875s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:23 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455
Jun 01 01:54:23 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:23 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd is fetched for user c27c76467f5f43e58f6b77359ac522f6. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bc40ac-6193-40cd-85b8-a924e0237625]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:23 devstack sudo[98436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD
Jun 01 01:54:23 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:23 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89 1073741824" returned: 0 in 0.990s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:23 devstack sudo[98439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89
Jun 01 01:54:23 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:23 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-fe837ef0-6a30-48ec-9f66-666884a41455" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-quobyte-fe837ef0-6a30-48ec-9f66-666884a41455" released by "delete_volume" :: held 1.680s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:24 devstack cinder-volume[86676]: WARNING cinder.quota [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1977936852-663423382 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1977936852-663423382, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:24 devstack cinder-volume[86676]: WARNING cinder.quota [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1977936852-663423382 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1977936852-663423382, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Created reservations ['5651e8d9-7f8e-48dc-bd27-acc1507681fa', '7af1c873-69a3-4687-87b8-b2895e76593c', 'e07811c1-0080-459d-8deb-c2135a764abd', '8b82fdf9-cf18-4aab-b310-1fc8dd67d261'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:24 devstack sudo[98445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:24 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:24 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:24 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89" returned: 0 in 0.675s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.243s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1744727861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c5c8fc-5a2b-4665-80a2-8108c3af9186,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:21Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Creating volume c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:24 devstack sudo[98454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 1073741824
Jun 01 01:54:24 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8879e26f-a828-4c18-b41c-92a70710376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ddeeb1-ee05-414d-b843-fafcd195b4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Volume volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89 (eaa0beff-2a34-4611-b1fa-18d55ad05f89): created successfully
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ddeeb1-ee05-414d-b843-fafcd195b4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Flow 'volume_create_manager' (29364f75-4e3c-489b-8475-76e1da0b2557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-16afca4d-470f-424d-9391-8cc6d43ef29d tempest-VolumeQuotasAdminTestJSON-2001465411 None] Created volume successfully.
Jun 01 01:54:24 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deleted volume successfully.
Jun 01 01:54:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-10eb856f-f457-4a15-b689-d03b691c0099 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-fe837ef0-6a30-48ec-9f66-666884a41455-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:25 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 1073741824" returned: 0 in 0.844s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:25 devstack sudo[98476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186
Jun 01 01:54:25 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a6114719-164a-4ea7-af8b-fceb282aafd6 tempest-VolumeQuotasAdminTestJSON-514637210 None] Transfer volume completed successfully.
Jun 01 01:54:26 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" returned: 0 in 0.609s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Attempting download of e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume c5c5c8fc-5a2b-4665-80a2-8108c3af9186. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd328a-b465-4a4c-843b-a9c1846a159d]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_1s96w_7y {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:26 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_1s96w_7y
Jun 01 01:54:26 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Acquiring lock "cinder-eaa0beff-2a34-4611-b1fa-18d55ad05f89-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Lock "cinder-eaa0beff-2a34-4611-b1fa-18d55ad05f89-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Acquiring lock "cinder-quobyte-eaa0beff-2a34-4611-b1fa-18d55ad05f89" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Lock "cinder-quobyte-eaa0beff-2a34-4611-b1fa-18d55ad05f89" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f07aef-c210-4f1a-bc89-bd328c0c424b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:26 devstack sudo[98481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89
Jun 01 01:54:26 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:26 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_1s96w_7y" returned: 0 in 0.738s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_1s96w_7y {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-a4f65d6e-5dd0-417c-81c2-7a95911081ed req-4db9d8ef-2299-4ba1-b44f-4b020db737f6 tempest-TestInstancesWithCinderVolumes-1318012948 None] Terminate volume connection completed successfully.
Jun 01 01:54:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-a4f65d6e-5dd0-417c-81c2-7a95911081ed req-4db9d8ef-2299-4ba1-b44f-4b020db737f6 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deleting attachment 815082fb-27c5-4c01-96da-e399ec15ad7e. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:54:26 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_1s96w_7y
Jun 01 01:54:26 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:27 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89" returned: 0 in 0.780s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:27 devstack sudo[98492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89
Jun 01 01:54:27 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:27 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_1s96w_7y" returned: 1 in 0.683s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_1s96w_7y' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c331f8dc-c4f7-4795-9d8a-c04e34d4d447]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:27 devstack sudo[98496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD
Jun 01 01:54:27 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:27 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-eaa0beff-2a34-4611-b1fa-18d55ad05f89" returned: 0 in 0.628s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Lock "cinder-quobyte-eaa0beff-2a34-4611-b1fa-18d55ad05f89" released by "delete_volume" :: held 1.452s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Created reservations ['0ec9b323-5d16-46cb-9625-05dbbff5aa76', '7d5e584a-9ec6-40ad-89ee-87d61fbddc26', '68ff5894-fd0f-4e30-8eed-03befe636a3d', '7825947e-ffb2-4d3b-b8bd-738136a041e5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:28 devstack sudo[98501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:28 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:28 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] e56da659-fc04-4789-a705-f5b7a7a6ddfd was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:28 devstack sudo[98505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186
Jun 01 01:54:28 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:28 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Deleted volume successfully.
Jun 01 01:54:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b7eea6a8-e373-4b99-a4f7-40de1eceb1df tempest-VolumeQuotasAdminTestJSON-2086823173 None] Lock "cinder-eaa0beff-2a34-4611-b1fa-18d55ad05f89-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "cinder-cf145984-ad45-41a9-a1cc-404e932d24d3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-cf145984-ad45-41a9-a1cc-404e932d24d3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "cinder-quobyte-cf145984-ad45-41a9-a1cc-404e932d24d3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-quobyte-cf145984-ad45-41a9-a1cc-404e932d24d3" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7122f531-3e1f-4939-9bff-85fcbc7dff54]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:29 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3
Jun 01 01:54:29 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:30 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3" returned: 0 in 1.295s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:30 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3
Jun 01 01:54:30 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:31 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" returned: 0 in 2.841s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_o9jt22bydevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:54:31 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Converted 112.00 MB image at 39.40 MB/s
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:31 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 1G
Jun 01 01:54:31 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:31 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cf145984-ad45-41a9-a1cc-404e932d24d3" returned: 0 in 0.866s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-quobyte-cf145984-ad45-41a9-a1cc-404e932d24d3" released by "delete_volume" :: held 2.239s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:31 devstack cinder-volume[86676]: WARNING cinder.quota [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538352274-1918883140 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538352274-1918883140, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:31 devstack cinder-volume[86676]: WARNING cinder.quota [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538352274-1918883140 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538352274-1918883140, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Created reservations ['cfbb7b03-f476-453a-a62c-fde7cfcfff77', 'a3a7e63f-1f07-4c9b-89a6-748747a55c49', 'ab45a635-3d8e-47ce-93e6-4ef98e22bc7f', '9913423f-9b98-41c5-a18d-dbb48ccb8386'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:31 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:31 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:32 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 1G" returned: 0 in 1.400s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:32 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:32 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Deleted volume successfully.
Jun 01 01:54:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ed92a-3801-4811-a5c8-179466233af4]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-22181511-2803-4dfe-bdb6-19e042afa8a4 tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-cf145984-ad45-41a9-a1cc-404e932d24d3-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:32 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186
Jun 01 01:54:32 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:33 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" returned: 0 in 1.013s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:33 devstack sudo[98548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186
Jun 01 01:54:33 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:34 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" returned: 1 in 1.072s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Downloaded image e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume c5c5c8fc-5a2b-4665-80a2-8108c3af9186 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd for user c27c76467f5f43e58f6b77359ac522f6 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Marking volume c5c5c8fc-5a2b-4665-80a2-8108c3af9186 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Copying metadata from image e56da659-fc04-4789-a705-f5b7a7a6ddfd to c5c5c8fc-5a2b-4665-80a2-8108c3af9186. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Creating volume glance metadata for volume c5c5c8fc-5a2b-4665-80a2-8108c3af9186 backed by image e56da659-fc04-4789-a705-f5b7a7a6ddfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779584fb-5f83-4af7-bbc6-613b07f1ac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b131760>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a48493-26af-4f05-8ba3-983c4933e6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Volume volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 (c5c5c8fc-5a2b-4665-80a2-8108c3af9186): created successfully
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a48493-26af-4f05-8ba3-983c4933e6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (13d7f091-48a5-433a-9794-501e453765b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fac70830-1d15-4f8e-b545-e34babd51a66 tempest-VolumesGetTest-965954459 None] Created volume successfully.
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (02120702-c99d-4088-8f8f-63cd0d5394ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f73515-dcf1-4fd5-9369-0a5601866f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f73515-dcf1-4fd5-9369-0a5601866f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1414661304',display_name='tempest-VolumesGetTest-Volume-1011343667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3503f97-17fa-4085-8622-af0158244d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:36Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42a0546-e5c7-4631-9722-076c7399afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42a0546-e5c7-4631-9722-076c7399afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2556be68-db84-41eb-8d67-4bec358a4109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2556be68-db84-41eb-8d67-4bec358a4109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3503f97-17fa-4085-8622-af0158244d30', 'volume_name': 'volume-e3503f97-17fa-4085-8622-af0158244d30', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0ae723-19a7-43cd-9aff-febf6c764060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0ae723-19a7-43cd-9aff-febf6c764060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddb20c8-fda3-4e5c-98d9-0df894541b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Volume e3503f97-17fa-4085-8622-af0158244d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3503f97-17fa-4085-8622-af0158244d30', 'volume_size': 1}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1414661304',display_name='tempest-VolumesGetTest-Volume-1011343667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3503f97-17fa-4085-8622-af0158244d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb124994113248dea030685a3a492020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:36Z,use_quota=True,user_id='c27c76467f5f43e58f6b77359ac522f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Creating volume e3503f97-17fa-4085-8622-af0158244d30 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:36 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30 1073741824
Jun 01 01:54:36 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-cce4e6fd-ec5e-4b8f-829a-ea6d0ba6c345 req-c9e4e690-4731-4143-b1f1-81b373a360ac tempest-TestInstancesWithCinderVolumes-1318012948 None] Terminate volume connection completed successfully.
Jun 01 01:54:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-cce4e6fd-ec5e-4b8f-829a-ea6d0ba6c345 req-c9e4e690-4731-4143-b1f1-81b373a360ac tempest-TestInstancesWithCinderVolumes-1318012948 None] Deleting attachment 8795ca43-2e06-473c-8252-8b7bc780f8f7. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:54:37 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30 1073741824" returned: 0 in 0.884s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:37 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30
Jun 01 01:54:37 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:38 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30" returned: 0 in 0.625s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddb20c8-fda3-4e5c-98d9-0df894541b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3503f97-17fa-4085-8622-af0158244d30', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bfb6e1-e4ce-42c0-8114-34e083a7dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Volume volume-e3503f97-17fa-4085-8622-af0158244d30 (e3503f97-17fa-4085-8622-af0158244d30): created successfully
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bfb6e1-e4ce-42c0-8114-34e083a7dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Flow 'volume_create_manager' (02120702-c99d-4088-8f8f-63cd0d5394ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-39bc138c-013d-4087-8a1b-54e1b509c384 tempest-VolumesGetTest-965954459 None] Created volume successfully.
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-38b32c67-3c54-4698-8ccc-0d184cc2a4a2 req-1ea6a298-0ec6-4af6-99ac-953970bcfa2e tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-38b32c67-3c54-4698-8ccc-0d184cc2a4a2 req-1ea6a298-0ec6-4af6-99ac-953970bcfa2e tempest-TestStampPattern-2091375347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[76876ba4-089b-402e-832d-2c99fd58adf8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-38b32c67-3c54-4698-8ccc-0d184cc2a4a2 req-1ea6a298-0ec6-4af6-99ac-953970bcfa2e tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Flow 'volume_create_manager' (3183c752-d4b2-4cd3-865e-05a5c209e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26aa5c2b-6be8-4fd7-9494-8703968e7604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26aa5c2b-6be8-4fd7-9494-8703968e7604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-673143811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18cd26c92404cc3bc112a832e1e6cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:38Z,use_quota=True,user_id='e9a0d61385f842bab37c24ce8bfbfa16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(429a7c30-eb7f-443c-bd58-b6d0332c7c21),volume_type_id=429a7c30-eb7f-443c-bd58-b6d0332c7c21)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063e6553-fc9b-4f7f-9bdf-28f84568ad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063e6553-fc9b-4f7f-9bdf-28f84568ad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca34e95e-d5fa-4322-ace3-9f640d6b3e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca34e95e-d5fa-4322-ace3-9f640d6b3e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5', 'volume_name': 'volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92125b3c-b156-4f7d-8234-040e1c70c28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:38 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:54:38 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92125b3c-b156-4f7d-8234-040e1c70c28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d8a23d-98c1-422b-b079-3c083187023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Volume 47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5', 'volume_size': 1}
Jun 01 01:54:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-e3503f97-17fa-4085-8622-af0158244d30-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Lock "cinder-e3503f97-17fa-4085-8622-af0158244d30-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-e3503f97-17fa-4085-8622-af0158244d30" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-e3503f97-17fa-4085-8622-af0158244d30" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:39 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-38b32c67-3c54-4698-8ccc-0d184cc2a4a2 req-1ea6a298-0ec6-4af6-99ac-953970bcfa2e tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 0.777s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-38b32c67-3c54-4698-8ccc-0d184cc2a4a2 req-1ea6a298-0ec6-4af6-99ac-953970bcfa2e tempest-TestStampPattern-2091375347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.807s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-673143811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18cd26c92404cc3bc112a832e1e6cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:38Z,use_quota=True,user_id='e9a0d61385f842bab37c24ce8bfbfa16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(429a7c30-eb7f-443c-bd58-b6d0332c7c21),volume_type_id=429a7c30-eb7f-443c-bd58-b6d0332c7c21)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Creating volume 47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:39 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6ddc2e-67cb-407c-9f27-1278f148d330]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:39 devstack sudo[98619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 1073741824
Jun 01 01:54:39 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-38b32c67-3c54-4698-8ccc-0d184cc2a4a2 req-1ea6a298-0ec6-4af6-99ac-953970bcfa2e tempest-TestStampPattern-2091375347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-644bab3c-978d-4724-82c0-60662850bbf0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf404681-0411-481b-b727-ab7caa05340c', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:54:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-38b32c67-3c54-4698-8ccc-0d184cc2a4a2 req-1ea6a298-0ec6-4af6-99ac-953970bcfa2e tempest-TestStampPattern-2091375347 None] attachment_update completed successfully.
Jun 01 01:54:39 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30
Jun 01 01:54:39 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:39 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30" returned: 0 in 0.821s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:40 devstack sudo[98697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30
Jun 01 01:54:40 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:40 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 1073741824" returned: 0 in 0.894s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:40 devstack sudo[98751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5
Jun 01 01:54:40 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:40 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-e3503f97-17fa-4085-8622-af0158244d30" returned: 0 in 0.670s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-e3503f97-17fa-4085-8622-af0158244d30" released by "delete_volume" :: held 1.547s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Created reservations ['4c187b0c-9eb4-4e4b-b2be-f10fe2885987', '3a766d6d-03a9-48ab-ac2f-3ca4bc190b53', '30308c44-29a5-4c02-9432-2f9908b7936e', 'b14dceb8-f61e-4f7c-ad27-389ffc7d966d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:40 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d8a23d-98c1-422b-b079-3c083187023c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870e2aa0-9119-4f8e-b5f2-65d95aa3a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Volume volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 (47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5): created successfully
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870e2aa0-9119-4f8e-b5f2-65d95aa3a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Flow 'volume_create_manager' (3183c752-d4b2-4cd3-865e-05a5c209e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=126,cinder:SELECT=115,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:54:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dd579ca3-8ff8-4544-b255-1ed8c689b33e tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Created volume successfully.
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=127,cinder:SELECT=112,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:40 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:40 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "cinder-cc7bda73-198e-43b9-a2e3-b5ef88242755-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-cc7bda73-198e-43b9-a2e3-b5ef88242755-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "cinder-quobyte-cc7bda73-198e-43b9-a2e3-b5ef88242755" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-quobyte-cc7bda73-198e-43b9-a2e3-b5ef88242755" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e57c34-312a-47bc-8113-c4373221a80d]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-c5c5c8fc-5a2b-4665-80a2-8108c3af9186-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Lock "cinder-c5c5c8fc-5a2b-4665-80a2-8108c3af9186-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Acquiring lock "cinder-quobyte-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:41 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:54:41 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:41 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.674s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Deleted volume successfully.
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0b9fe519-9a92-4255-b800-852db96be1b2 tempest-VolumesGetTest-965954459 None] Lock "cinder-e3503f97-17fa-4085-8622-af0158244d30-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf79c10-204e-4232-9b0f-f973800c1437]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:41 devstack sudo[99024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186
Jun 01 01:54:41 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:42 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:42 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:42 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 0 in 0.782s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:42 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:54:42 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:42 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" returned: 0 in 0.780s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:42 devstack sudo[99035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186
Jun 01 01:54:42 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:42 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.620s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d1ddf6c7-c930-4342-8a04-0cc3cf744f63 tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Retype volume completed successfully.
Jun 01 01:54:42 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 1 in 0.761s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:54:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:42 devstack sudo[99041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755
Jun 01 01:54:42 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:43 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" returned: 1 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:43 devstack sudo[99046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186
Jun 01 01:54:43 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Acquiring lock "cinder-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "cinder-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Acquiring lock "cinder-quobyte-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "cinder-quobyte-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006565c-1506-451d-a9e7-6f7bc05212df]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:43 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5
Jun 01 01:54:43 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:43 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cc7bda73-198e-43b9-a2e3-b5ef88242755" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-quobyte-cc7bda73-198e-43b9-a2e3-b5ef88242755" released by "delete_volume" :: held 2.381s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:43 devstack cinder-volume[86676]: WARNING cinder.quota [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1373961693-1607824355 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1373961693-1607824355, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:43 devstack cinder-volume[86676]: WARNING cinder.quota [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1373961693-1607824355 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1373961693-1607824355, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Created reservations ['5e58d637-1a0d-4252-b80a-75fa20e58a3e', '260b88b1-ba61-45ab-8abd-503ff0ec9ffb', '3da84808-c504-48b3-8787-06f26b981de8', 'e4a24783-a341-4095-8eaa-00c637c0ed17'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:43 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" returned: 0 in 0.697s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Lock "cinder-quobyte-c5c5c8fc-5a2b-4665-80a2-8108c3af9186" released by "delete_volume" :: held 2.365s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:43 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:43 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Created reservations ['56d78288-a7d5-4c6e-9a0f-731f62d7b536', '0cc0244d-2c34-4049-8a1a-41759e2fd589', 'b93a2c47-5aba-4c32-a7a9-391f9b81d7a4', 'df76bf71-1b50-4e2e-8418-300533c9d9df'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:43 devstack sudo[99064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:44 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:44 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5" returned: 0 in 0.915s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:44 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5
Jun 01 01:54:44 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:44 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Deleted volume successfully.
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-34e8c90e-bd7d-48e5-b89a-12d8c49ccc8d tempest-TestInstancesWithCinderVolumes-1318012948 None] Lock "cinder-cc7bda73-198e-43b9-a2e3-b5ef88242755-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:44 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Deleted volume successfully.
Jun 01 01:54:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f5daf173-1f4b-49f4-90f1-9ef84e33e7c3 tempest-VolumesGetTest-965954459 None] Lock "cinder-c5c5c8fc-5a2b-4665-80a2-8108c3af9186-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:45 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "cinder-quobyte-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5" released by "delete_volume" :: held 1.754s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:45 devstack cinder-volume[86676]: WARNING cinder.quota [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:45 devstack cinder-volume[86676]: WARNING cinder.quota [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Created reservations ['48f21f92-30c3-483c-9781-46b11479cf67', '20f2e46e-5e32-4660-9a68-77344197bd0a', '15aa1174-a4c4-410a-91b7-969f648de10c', 'bc880965-3f07-492d-af01-ac6fb8910389'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:45 devstack sudo[99074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:45 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:46 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.991s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Deleted volume successfully.
Jun 01 01:54:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c3c2b940-128a-4765-9399-b6d5b241cf8d tempest-VolumeRetypeWithoutMigrationTest-1677295020 None] Lock "cinder-47bc14ba-7d26-4f3b-82d6-aa669ef5e8a5-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:54:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-6d14f77d-dbee-42f9-bcf5-7a47349426c7 req-5163a7dc-c0f5-4a5e-bb94-8305a75a5c03 tempest-TestStampPattern-2091375347 None] Terminate volume connection completed successfully.
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-6d14f77d-dbee-42f9-bcf5-7a47349426c7 req-5163a7dc-c0f5-4a5e-bb94-8305a75a5c03 tempest-TestStampPattern-2091375347 None] Deleting attachment bf404681-0411-481b-b727-ab7caa05340c. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Flow 'volume_create_manager' (e92d73f6-bdf9-4bdb-939f-49c1a6f0f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a4e2a-c106-4c51-a1d2-800bffc12c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a4e2a-c106-4c51-a1d2-800bffc12c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-3989160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38454518-9005-41dc-8a4f-3a18e1f0fea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9be84fb7cdc34a0e948d4ed7663e0eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:48Z,use_quota=True,user_id='02cabf4caf3442438e5721f05a2dc1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857e1a66-e7d3-4029-8fd3-081b055d416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857e1a66-e7d3-4029-8fd3-081b055d416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bca43a-4ddc-47fc-9230-4da0aded0133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bca43a-4ddc-47fc-9230-4da0aded0133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38454518-9005-41dc-8a4f-3a18e1f0fea2', 'volume_name': 'volume-38454518-9005-41dc-8a4f-3a18e1f0fea2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51b25ba-8635-4a2a-b2b1-1f7e7f9ca5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51b25ba-8635-4a2a-b2b1-1f7e7f9ca5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbb71c9-e1bc-45f3-83b6-7a12e28db49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Volume 38454518-9005-41dc-8a4f-3a18e1f0fea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38454518-9005-41dc-8a4f-3a18e1f0fea2', 'volume_size': 1}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-3989160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38454518-9005-41dc-8a4f-3a18e1f0fea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9be84fb7cdc34a0e948d4ed7663e0eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:48Z,use_quota=True,user_id='02cabf4caf3442438e5721f05a2dc1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Creating volume 38454518-9005-41dc-8a4f-3a18e1f0fea2 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:48 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:48 devstack sudo[99117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2 1073741824
Jun 01 01:54:48 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:49 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2 1073741824" returned: 0 in 0.994s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:49 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2
Jun 01 01:54:49 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:50 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2" returned: 0 in 0.890s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbb71c9-e1bc-45f3-83b6-7a12e28db49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38454518-9005-41dc-8a4f-3a18e1f0fea2', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eee1dc-be42-416e-81a0-b2882464b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:50 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Volume volume-38454518-9005-41dc-8a4f-3a18e1f0fea2 (38454518-9005-41dc-8a4f-3a18e1f0fea2): created successfully
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eee1dc-be42-416e-81a0-b2882464b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Flow 'volume_create_manager' (e92d73f6-bdf9-4bdb-939f-49c1a6f0f933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-90129385-e003-4feb-a4c5-493be2be24af tempest-VolumesListTestJSON-1939698502 None] Created volume successfully.
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Creating offline snapshot 7525dca7-4b66-4353-bb94-bcad70db4357 of volume 644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdff4757-5a88-4a47-b01d-9a7e1d897a39]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:54:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:50 devstack sudo[99161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:54:50 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:51 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 0.892s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:51 devstack sudo[99168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 1G
Jun 01 01:54:51 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Flow 'volume_create_manager' (a3c63edf-5a05-4c56-8fff-f6e934771148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ca07a8-744a-4f8f-97d8-b4de5897552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:52 devstack sudo[99174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:54:52 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ca07a8-744a-4f8f-97d8-b4de5897552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1225400122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9be84fb7cdc34a0e948d4ed7663e0eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:52Z,use_quota=True,user_id='02cabf4caf3442438e5721f05a2dc1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b009fdd-de9f-4e56-b2c3-6dc31024dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b009fdd-de9f-4e56-b2c3-6dc31024dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88521c8d-639a-4e59-9e8f-a67cae7d9860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88521c8d-639a-4e59-9e8f-a67cae7d9860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63', 'volume_name': 'volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b454eaaf-1236-4ad7-98c6-5fc7af8593e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b454eaaf-1236-4ad7-98c6-5fc7af8593e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47d9fda-6751-4c5f-8536-460967c1031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:52 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Volume 7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63', 'volume_size': 1}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:52 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 1G" returned: 0 in 1.017s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-644bab3c-978d-4724-82c0-60662850bbf0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:52 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-644bab3c-978d-4724-82c0-60662850bbf0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357
Jun 01 01:54:52 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:53 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:54:53 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-644bab3c-978d-4724-82c0-60662850bbf0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357" returned: 0 in 0.780s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:53 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 is being set with open permissions: ugo+rw
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:53 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357
Jun 01 01:54:53 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:53 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357" returned: 0 in 0.637s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:54 devstack sudo[99191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.info
Jun 01 01:54:54 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:54 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.info" returned: 0 in 0.738s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:54 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.info is being set with open permissions: ugo+rw
Jun 01 01:54:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:54 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.info
Jun 01 01:54:54 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:55 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.info" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.960s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.083s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1225400122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9be84fb7cdc34a0e948d4ed7663e0eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:52Z,use_quota=True,user_id='02cabf4caf3442438e5721f05a2dc1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Creating volume 7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:55 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:55 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 1073741824
Jun 01 01:54:55 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5fe68245-b577-4309-a2b6-3aebc7f6d347 tempest-TestStampPattern-2091375347 None] Create snapshot completed successfully
Jun 01 01:54:56 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 1073741824" returned: 0 in 0.992s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:56 devstack sudo[99209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63
Jun 01 01:54:56 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:57 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63" returned: 0 in 0.787s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:54:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47d9fda-6751-4c5f-8536-460967c1031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b3411a-be4b-4e5e-8c94-11b1f6200f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:57 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Volume volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 (7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63): created successfully
Jun 01 01:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b3411a-be4b-4e5e-8c94-11b1f6200f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:57 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Flow 'volume_create_manager' (a3c63edf-5a05-4c56-8fff-f6e934771148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:57 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-70eff355-4920-4e48-bb5d-0ae6aaf3d55e tempest-VolumesListTestJSON-1939698502 None] Created volume successfully.
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Flow 'volume_create_manager' (b0e5b189-a4ff-4450-82d1-63d8217f4884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af9f140-2f06-4ed7-8c6a-e212762d9208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af9f140-2f06-4ed7-8c6a-e212762d9208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1178551167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d5ff2a-be86-4776-a208-f7ff9c25fdf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9be84fb7cdc34a0e948d4ed7663e0eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:58Z,use_quota=True,user_id='02cabf4caf3442438e5721f05a2dc1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfcd1e1-2fdd-4fb2-8140-8aac32489661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfcd1e1-2fdd-4fb2-8140-8aac32489661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c71ccb0-9037-436f-aa7d-f9a820467b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c71ccb0-9037-436f-aa7d-f9a820467b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d5ff2a-be86-4776-a208-f7ff9c25fdf8', 'volume_name': 'volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce7b0ae-351d-4a81-9805-5c7905b02a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce7b0ae-351d-4a81-9805-5c7905b02a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bec107-1233-4451-98c0-a836f028a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:54:58 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Volume 88d5ff2a-be86-4776-a208-f7ff9c25fdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8', 'volume_size': 1}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1178551167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d5ff2a-be86-4776-a208-f7ff9c25fdf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9be84fb7cdc34a0e948d4ed7663e0eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:54:58Z,use_quota=True,user_id='02cabf4caf3442438e5721f05a2dc1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Creating volume 88d5ff2a-be86-4776-a208-f7ff9c25fdf8 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:54:58 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:54:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:58 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8 1073741824
Jun 01 01:54:58 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:54:59 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Jun 01 01:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8 1073741824" returned: 0 in 1.066s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:54:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:54:59 devstack sudo[99218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8
Jun 01 01:54:59 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:00 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8" returned: 0 in 0.681s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:55:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bec107-1233-4451-98c0-a836f028a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43dec2ef-8708-42b5-9bc7-5be6f56c0ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Volume volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8 (88d5ff2a-be86-4776-a208-f7ff9c25fdf8): created successfully
Jun 01 01:55:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43dec2ef-8708-42b5-9bc7-5be6f56c0ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Flow 'volume_create_manager' (b0e5b189-a4ff-4450-82d1-63d8217f4884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3d40f9e4-53bb-4313-80d0-e5afb012d615 tempest-VolumesListTestJSON-1939698502 None] Created volume successfully.
Jun 01 01:55:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "cinder-88d5ff2a-be86-4776-a208-f7ff9c25fdf8-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-88d5ff2a-be86-4776-a208-f7ff9c25fdf8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "cinder-quobyte-88d5ff2a-be86-4776-a208-f7ff9c25fdf8" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-quobyte-88d5ff2a-be86-4776-a208-f7ff9c25fdf8" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ccc95-2df4-44e3-8b26-6005dbbca8fb]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:03 devstack sudo[99597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8
Jun 01 01:55:03 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:04 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8" returned: 0 in 0.861s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:04 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8
Jun 01 01:55:04 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:05 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88d5ff2a-be86-4776-a208-f7ff9c25fdf8" returned: 0 in 0.942s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-quobyte-88d5ff2a-be86-4776-a208-f7ff9c25fdf8" released by "delete_volume" :: held 1.874s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Created reservations ['bcc96311-49aa-4cac-9c16-d484b7b7c48e', 'a63dbd4d-4455-4b1f-a179-aa832b29d4aa', 'd83b8d89-95b6-4a5c-bd95-dd080eee7658', '79c10e68-d193-4723-946b-f5f6d7994179'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:05 devstack sudo[99605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:55:05 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "cinder-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "cinder-quobyte-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-quobyte-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63" acquired by "delete_volume" :: waited 0.035s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab116a1f-c946-441e-ba04-c45968026b07]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:06 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63
Jun 01 01:55:06 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:06 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.898s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:06 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:55:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Deleted volume successfully.
Jun 01 01:55:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7575baa5-ec31-49f1-b128-4762241f6808 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-88d5ff2a-be86-4776-a208-f7ff9c25fdf8-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:07 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63" returned: 0 in 0.971s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:07 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63
Jun 01 01:55:07 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Flow 'volume_create_manager' (f326b9ed-84a9-4a07-aef5-abf1e2650a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04946656-5cca-4091-aadf-ed5e8b125039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04946656-5cca-4091-aadf-ed5e8b125039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1108951971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49975cd06e0745e1bef81ae35d829d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7525dca7-4b66-4353-bb94-bcad70db4357,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:07Z,use_quota=True,user_id='dce623c153fd46288f63576e0a2a1bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163fb8e7-8145-4050-915f-39705432330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163fb8e7-8145-4050-915f-39705432330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfb7525-f3fd-490a-8f18-78f945938778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfb7525-f3fd-490a-8f18-78f945938778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06', 'volume_name': 'volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06', 'volume_size': 1, 'snapshot_id': '7525dca7-4b66-4353-bb94-bcad70db4357'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efce5cfe-7f38-426b-9994-0c6568b75d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efce5cfe-7f38-426b-9994-0c6568b75d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b37503d-a92f-4040-a9f4-df7333db1bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Volume aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06', 'volume_size': 1, 'snapshot_id': '7525dca7-4b66-4353-bb94-bcad70db4357'}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-quobyte-7525dca7-4b66-4353-bb94-bcad70db4357-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-7525dca7-4b66-4353-bb94-bcad70db4357-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Creating volume aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 from snapshot 7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-quobyte-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] snapshot: 7525dca7-4b66-4353-bb94-bcad70db4357, volume: aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c66b941-c18d-41bf-8710-a54bb3ff2841]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:07 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63" returned: 0 in 0.875s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-quobyte-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63" released by "delete_volume" :: held 1.923s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Created reservations ['5ef03e82-06f5-43f4-8134-2bbd2c0dc00e', '38b882d7-f2ca-4db5-8a01-d6e5e4be4a96', '457bfb21-e708-417c-aa2e-e594255a07ed', '4f90e3da-1386-41dd-9538-e6ae4d8a3a6f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:55:08 devstack sudo[99616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357
Jun 01 01:55:08 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:08 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:55:08 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "cinder-38454518-9005-41dc-8a4f-3a18e1f0fea2-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-38454518-9005-41dc-8a4f-3a18e1f0fea2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "cinder-quobyte-38454518-9005-41dc-8a4f-3a18e1f0fea2" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-quobyte-38454518-9005-41dc-8a4f-3a18e1f0fea2" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a74469f-d143-4cc9-ad7f-cd5a0fb448cf]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:08 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2
Jun 01 01:55:08 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:08 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357" returned: 0 in 1.111s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-644bab3c-978d-4724-82c0-60662850bbf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81b37d-0910-415f-9960-fa5f8560bc8a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:09 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.039s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:09 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:55:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Deleted volume successfully.
Jun 01 01:55:09 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:55:09 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f39e94c5-05d8-49a1-9a2d-2ac8aad30915 tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-7e7df80a-0a8c-4869-bc95-dcc4fa8ddd63-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:09 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2" returned: 0 in 1.205s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:09 devstack sudo[99631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2
Jun 01 01:55:09 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:10 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 1.098s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:10 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06
Jun 01 01:55:10 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:10 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-38454518-9005-41dc-8a4f-3a18e1f0fea2" returned: 0 in 0.956s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-quobyte-38454518-9005-41dc-8a4f-3a18e1f0fea2" released by "delete_volume" :: held 2.227s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Created reservations ['1db6b7d2-0d92-4c98-8101-159d6970648e', '0f8049c9-081b-48fa-b998-241f50b1cbb2', '511aad2d-3a9a-418b-97fe-c24d1ae0f7bb', 'f83dfd0c-1978-4d9a-9ab9-9a564de10ea7'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:11 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:55:11 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:12 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.512s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:12 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:55:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Deleted volume successfully.
Jun 01 01:55:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-db74d3e0-2d70-4894-be14-a9a4ac1869bb tempest-VolumesListTestJSON-1939698502 None] Lock "cinder-38454518-9005-41dc-8a4f-3a18e1f0fea2-delete_volume" released by "delete_volume" :: held 4.196s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Flow 'volume_create_manager' (6db94a7c-f641-43a7-840e-3ebbb0058a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eadfb35-0168-49cd-8a90-9afc9bc3ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eadfb35-0168-49cd-8a90-9afc9bc3ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-597977927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09931dc4-8d27-4715-afe6-00989f8839ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70a6935c12a455a94cf4ba65c73e2c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:17Z,use_quota=True,user_id='aac6d81ea0ff4e848ec44f4e4e8aad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e341d9d-f990-4039-8c5b-fd2b31fad0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e341d9d-f990-4039-8c5b-fd2b31fad0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8f3b27-dd86-474b-b6ff-2eab6d8a76c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8f3b27-dd86-474b-b6ff-2eab6d8a76c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09931dc4-8d27-4715-afe6-00989f8839ef', 'volume_name': 'volume-09931dc4-8d27-4715-afe6-00989f8839ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e40a6-b394-4015-81d4-3b0126234493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e40a6-b394-4015-81d4-3b0126234493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39b5dd0-f914-4dd3-b81a-3bb3bf2c583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Volume 09931dc4-8d27-4715-afe6-00989f8839ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09931dc4-8d27-4715-afe6-00989f8839ef', 'volume_size': 1}
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:17 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" returned: 0 in 7.879s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a74abc5-ae3b-4228-b227-347268d134d7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:18 devstack sudo[99742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:55:18 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Flow 'volume_create_manager' (39a6c230-7e78-4286-ba90-82910e305fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aef2cbc-f980-47b1-b14a-80c649dc9c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aef2cbc-f980-47b1-b14a-80c649dc9c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1789973961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9582619c-20d4-45c6-8a34-26591c0e2dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c119134fb9413ea98f8168d2d1601d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:19Z,use_quota=True,user_id='4182a38097c34e5fa1513f93efff2af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f61c9b8-7967-40e7-89e6-cad29fce9632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f61c9b8-7967-40e7-89e6-cad29fce9632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59616d59-4eed-4327-9ac7-adab0e5fa1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59616d59-4eed-4327-9ac7-adab0e5fa1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9582619c-20d4-45c6-8a34-26591c0e2dbf', 'volume_name': 'volume-9582619c-20d4-45c6-8a34-26591c0e2dbf', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c3f2bd-25fe-428b-ab59-f4df09434760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c3f2bd-25fe-428b-ab59-f4df09434760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d29b13-8231-444f-a546-9fa019467f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:19 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Volume 9582619c-20d4-45c6-8a34-26591c0e2dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9582619c-20d4-45c6-8a34-26591c0e2dbf', 'volume_size': 1}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:19 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 1.614s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0, size 1024.00 MB, duration 7.88 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:55:19 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Converted 1024.00 MB image at 129.94 MB/s
Jun 01 01:55:19 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 is being set with open permissions: ugo+rw
Jun 01 01:55:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:19 devstack sudo[99749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06
Jun 01 01:55:19 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:20 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" returned: 0 in 0.808s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" released by "_copy_volume_from_snapshot" :: held 12.701s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-7525dca7-4b66-4353-bb94-bcad70db4357-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" released by "_create_volume_from_snapshot" :: held 12.768s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.811s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-597977927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09931dc4-8d27-4715-afe6-00989f8839ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70a6935c12a455a94cf4ba65c73e2c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:17Z,use_quota=True,user_id='aac6d81ea0ff4e848ec44f4e4e8aad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Creating volume 09931dc4-8d27-4715-afe6-00989f8839ef {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:55:20 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:20 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef 1073741824
Jun 01 01:55:20 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b37503d-a92f-4040-a9f4-df7333db1bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06', 'volume_size': 1, 'snapshot_id': '7525dca7-4b66-4353-bb94-bcad70db4357'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba69090-2110-4521-b2f9-ac6c1006f398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:20 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Volume volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 (aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06): created successfully
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba69090-2110-4521-b2f9-ac6c1006f398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:20 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Flow 'volume_create_manager' (f326b9ed-84a9-4a07-aef5-abf1e2650a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8d63495f-db90-4537-8090-a6d51ac17495 tempest-TestStampPattern-2091375347 None] Created volume successfully.
Jun 01 01:55:21 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef 1073741824" returned: 0 in 1.004s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:21 devstack sudo[99787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef
Jun 01 01:55:21 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:22 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1789973961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9582619c-20d4-45c6-8a34-26591c0e2dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c119134fb9413ea98f8168d2d1601d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:19Z,use_quota=True,user_id='4182a38097c34e5fa1513f93efff2af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Creating volume 9582619c-20d4-45c6-8a34-26591c0e2dbf {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:55:22 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39b5dd0-f914-4dd3-b81a-3bb3bf2c583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09931dc4-8d27-4715-afe6-00989f8839ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:22 devstack sudo[99790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf 1073741824
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eb7354-4022-493c-a8d1-a82c9a1d3001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:22 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Volume volume-09931dc4-8d27-4715-afe6-00989f8839ef (09931dc4-8d27-4715-afe6-00989f8839ef): created successfully
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eb7354-4022-493c-a8d1-a82c9a1d3001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Flow 'volume_create_manager' (6db94a7c-f641-43a7-840e-3ebbb0058a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-09864b77-bef1-43b0-bbeb-4c36fe2a2b2d tempest-AbsoluteLimitsTests-1537571348 None] Created volume successfully.
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Acquiring lock "cinder-09931dc4-8d27-4715-afe6-00989f8839ef-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Lock "cinder-09931dc4-8d27-4715-afe6-00989f8839ef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Acquiring lock "cinder-quobyte-09931dc4-8d27-4715-afe6-00989f8839ef" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Lock "cinder-quobyte-09931dc4-8d27-4715-afe6-00989f8839ef" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6974b50c-e04f-43ea-81be-8833a28baccb]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:23 devstack sudo[99792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef
Jun 01 01:55:23 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:23 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf 1073741824" returned: 0 in 1.110s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:23 devstack sudo[99798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf
Jun 01 01:55:23 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:23 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef" returned: 0 in 0.915s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:23 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef
Jun 01 01:55:23 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:24 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf" returned: 0 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d29b13-8231-444f-a546-9fa019467f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9582619c-20d4-45c6-8a34-26591c0e2dbf', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6c3dd-cbce-450a-be6f-8130d35fd79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Volume volume-9582619c-20d4-45c6-8a34-26591c0e2dbf (9582619c-20d4-45c6-8a34-26591c0e2dbf): created successfully
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6c3dd-cbce-450a-be6f-8130d35fd79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Flow 'volume_create_manager' (39a6c230-7e78-4286-ba90-82910e305fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2dcfe599-44d6-4e77-b91e-7e7b6f47488d tempest-VolumesNegativeTest-1077853005 None] Created volume successfully.
Jun 01 01:55:24 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-09931dc4-8d27-4715-afe6-00989f8839ef" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Lock "cinder-quobyte-09931dc4-8d27-4715-afe6-00989f8839ef" released by "delete_volume" :: held 1.680s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Created reservations ['7f74252e-65fd-4682-a1f4-5f0af2f751b5', '7833b5f6-8dd6-4a6f-af40-57069d269b8f', '46728eaf-f764-4fb5-a35d-6fc9500102f2', 'f0239d7e-b2a6-40b7-ba78-5211c522ca15'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:24 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:55:24 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:25 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.868s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:25 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:55:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Deleted volume successfully.
Jun 01 01:55:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-eea5ea67-6102-4c39-921e-a832a8fa5940 tempest-AbsoluteLimitsTests-1537571348 None] Lock "cinder-09931dc4-8d27-4715-afe6-00989f8839ef-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Flow 'volume_create_manager' (8d91f196-3694-4977-a48e-ab43ca10d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0877c1-246a-44fe-b93a-a8bd43864b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0877c1-246a-44fe-b93a-a8bd43864b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-823981586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421e27b2-d5aa-4bf1-836b-f4575eb10ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b3a77bd624d0a8720f977974a49ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:33Z,use_quota=True,user_id='2b26a59e38724ada9107ef58b7d2007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a852e222-f507-4c4d-b845-ca1d47f57b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a852e222-f507-4c4d-b845-ca1d47f57b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7182517f-82d0-455c-ac72-53bb8b0a4d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7182517f-82d0-455c-ac72-53bb8b0a4d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421e27b2-d5aa-4bf1-836b-f4575eb10ec0', 'volume_name': 'volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395077ee-7a37-4d21-8867-c958eccb7859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395077ee-7a37-4d21-8867-c958eccb7859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea19c55-eeb4-443d-89da-b06768370c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Volume 421e27b2-d5aa-4bf1-836b-f4575eb10ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0', 'volume_size': 1}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-823981586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421e27b2-d5aa-4bf1-836b-f4575eb10ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b3a77bd624d0a8720f977974a49ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:33Z,use_quota=True,user_id='2b26a59e38724ada9107ef58b7d2007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Creating volume 421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:55:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:55:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:32 devstack sudo[99857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 1073741824
Jun 01 01:55:32 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:34 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 1073741824" returned: 0 in 1.786s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:34 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0
Jun 01 01:55:34 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:35 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" returned: 0 in 1.126s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] <== create_volume: return (2980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:55:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea19c55-eeb4-443d-89da-b06768370c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6713879-3828-4403-8324-881396ce2558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Volume volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 (421e27b2-d5aa-4bf1-836b-f4575eb10ec0): created successfully
Jun 01 01:55:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6713879-3828-4403-8324-881396ce2558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Flow 'volume_create_manager' (8d91f196-3694-4977-a48e-ab43ca10d668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6caf28f4-f514-41f2-825c-232c5636ab03 tempest-VolumesDeleteCascade-886328931 None] Created volume successfully.
Jun 01 01:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Creating offline snapshot 5c9267a7-4ef7-4bac-bb99-7261b4209ea2 of volume 421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:55:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c328fb6-4f66-428a-98b5-70cc8da46c6e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:37 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0
Jun 01 01:55:37 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:38 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" returned: 0 in 1.481s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:38 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 1G
Jun 01 01:55:38 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:39 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 1G" returned: 0 in 1.458s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:39 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2
Jun 01 01:55:39 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:40 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2" returned: 0 in 0.857s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:40 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 is being set with open permissions: ugo+rw
Jun 01 01:55:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:40 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2
Jun 01 01:55:40 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:41 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2" returned: 0 in 0.855s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:41 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=76,cinder:SELECT=58,cinder:INSERT=17,cinder:DELETE=9 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:55:41 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=68,cinder:DELETE=7,cinder:UPDATE=89,cinder:INSERT=18 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:55:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:41 devstack sudo[99930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.info
Jun 01 01:55:41 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:41 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.info" returned: 0 in 0.654s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:42 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.info is being set with open permissions: ugo+rw
Jun 01 01:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:42 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.info
Jun 01 01:55:42 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:42 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.info" returned: 0 in 0.584s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.016s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-59362c06-0ada-4639-9d5b-cf17a20774ff tempest-VolumesDeleteCascade-886328931 None] Create snapshot completed successfully
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Creating offline snapshot 1208b7f4-6cdb-4537-88d8-c834f75bda06 of volume 421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b83ae1c-3f63-4e5a-ace8-c88bebdf5053]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:43 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2
Jun 01 01:55:43 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:43 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2" returned: 0 in 0.739s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:55:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:43 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 1G
Jun 01 01:55:43 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:45 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 1G" returned: 0 in 1.097s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:45 devstack sudo[100001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06
Jun 01 01:55:45 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:45 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06" returned: 0 in 0.984s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:45 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 is being set with open permissions: ugo+rw
Jun 01 01:55:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:46 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06
Jun 01 01:55:46 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:47 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06" returned: 0 in 1.057s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.031s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3e2107d4-ad9a-44f2-8129-77047d9c40ae tempest-VolumesDeleteCascade-886328931 None] Create snapshot completed successfully
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-421e27b2-d5aa-4bf1-836b-f4575eb10ec0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-421e27b2-d5aa-4bf1-836b-f4575eb10ec0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Performing cascade delete. {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-1208b7f4-6cdb-4537-88d8-c834f75bda06-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-1208b7f4-6cdb-4537-88d8-c834f75bda06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-1208b7f4-6cdb-4537-88d8-c834f75bda06" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-1208b7f4-6cdb-4537-88d8-c834f75bda06" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Deleting offline snapshot 1208b7f4-6cdb-4537-88d8-c834f75bda06 of volume 421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] snapshot_file for this snap is: volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[63354ce5-4a10-4e71-90a3-0e553098c215]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:48 devstack sudo[100021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06
Jun 01 01:55:48 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:49 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06" returned: 0 in 1.350s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:55:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c23ce8-3f73-4252-8023-ae186bd2b6f9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:49 devstack sudo[100047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2
Jun 01 01:55:49 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:50 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2" returned: 0 in 1.009s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:55:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:50 devstack sudo[100129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06
Jun 01 01:55:50 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:51 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06" returned: 0 in 0.861s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:51 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06
Jun 01 01:55:51 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:51 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.1208b7f4-6cdb-4537-88d8-c834f75bda06" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-1208b7f4-6cdb-4537-88d8-c834f75bda06" released by "_delete_snapshot" :: held 4.035s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" released by "delete_snapshot" :: held 4.095s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:51 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Created reservations ['35982c7d-6f56-4fd5-b02a-1b5ba4cbb8fb', 'b1cf5094-cb7b-4d27-b697-21ea70317993', '35fbdcea-94da-4307-b024-3988f0c08672', '0f2e05bb-4513-4218-8f69-c2572879fbf3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:55:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Delete snapshot completed successfully.
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-1208b7f4-6cdb-4537-88d8-c834f75bda06-delete_snapshot" released by "delete_snapshot" :: held 4.398s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-5c9267a7-4ef7-4bac-bb99-7261b4209ea2-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-5c9267a7-4ef7-4bac-bb99-7261b4209ea2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-5c9267a7-4ef7-4bac-bb99-7261b4209ea2" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-5c9267a7-4ef7-4bac-bb99-7261b4209ea2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Deleting offline snapshot 5c9267a7-4ef7-4bac-bb99-7261b4209ea2 of volume 421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] snapshot_file for this snap is: volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[839bca0a-546e-495b-bc3b-55e006f25da7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:52 devstack sudo[100153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2
Jun 01 01:55:52 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:52 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:55:52 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:53 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2" returned: 0 in 0.884s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:55:53 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0fab88-0562-4e34-8fe5-516281f6f422]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:53 devstack sudo[100165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0
Jun 01 01:55:53 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:53 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:53 devstack sudo[100171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2
Jun 01 01:55:53 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:54 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2" returned: 0 in 0.721s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:54 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2
Jun 01 01:55:54 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:55 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0.5c9267a7-4ef7-4bac-bb99-7261b4209ea2" returned: 0 in 1.044s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-5c9267a7-4ef7-4bac-bb99-7261b4209ea2" released by "_delete_snapshot" :: held 3.615s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" released by "delete_snapshot" :: held 3.643s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Created reservations ['3620e4fd-dcf4-451d-aff3-eced9f7433d4', '6446c780-886e-4899-9521-d7ff3b4e0a0f', 'f09826cb-fce8-4d05-b5f8-853ddc0bc5a5', '700d7441-245c-4353-b06a-088488bc1332'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:55:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Delete snapshot completed successfully.
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-5c9267a7-4ef7-4bac-bb99-7261b4209ea2-delete_snapshot" released by "delete_snapshot" :: held 3.799s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Snapshots deleted, issuing volume delete {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d274b19d-2741-4e0d-bf1b-290ee2208ccb]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:55:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:56 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0
Jun 01 01:55:56 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:56 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" returned: 0 in 0.815s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:56 devstack sudo[100261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0
Jun 01 01:55:56 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:57 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" returned: 0 in 0.746s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-421e27b2-d5aa-4bf1-836b-f4575eb10ec0" released by "delete_volume" :: held 1.633s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Created reservations ['0fba7917-a093-4365-b286-e5b84c1b65e0', 'd6df343c-9807-4895-9fc5-1b30a7ff3dcc', 'fcd9191e-2a3d-40df-9b25-6e7ae615a0d1', '54fc996d-3674-49c8-b4d4-72e6ff5ffc3e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:57 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:55:57 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:58 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Jun 01 01:55:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.970s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:55:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:55:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Deleted volume successfully.
Jun 01 01:55:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d846f923-c0d1-49f6-ba22-c5a35ff834d2 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-421e27b2-d5aa-4bf1-836b-f4575eb10ec0-delete_volume" released by "delete_volume" :: held 11.165s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Flow 'volume_create_manager' (5f11a8fe-7f9d-4e55-a5e0-869f198eab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403c1ad5-206d-4e80-a674-1f3a299f0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403c1ad5-206d-4e80-a674-1f3a299f0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-325825814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c23a92f-aacf-4ae0-97aa-d8f8e361532a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b3a77bd624d0a8720f977974a49ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:59Z,use_quota=True,user_id='2b26a59e38724ada9107ef58b7d2007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1cda4a-febe-4320-b589-2f8a418ce580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1cda4a-febe-4320-b589-2f8a418ce580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364d27c5-1ad7-4b2d-8f06-58df92351a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364d27c5-1ad7-4b2d-8f06-58df92351a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c23a92f-aacf-4ae0-97aa-d8f8e361532a', 'volume_name': 'volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1a7006-a78c-45e7-b08a-844f24f02bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1a7006-a78c-45e7-b08a-844f24f02bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36735381-aa28-4c1c-b352-a2360f9e0eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:55:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Volume 6c23a92f-aacf-4ae0-97aa-d8f8e361532a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a', 'volume_size': 1}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-325825814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c23a92f-aacf-4ae0-97aa-d8f8e361532a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b3a77bd624d0a8720f977974a49ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:55:59Z,use_quota=True,user_id='2b26a59e38724ada9107ef58b7d2007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Creating volume 6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:55:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:55:59 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a 1073741824
Jun 01 01:55:59 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:55:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-61b9abfd-2f51-429e-893b-fe6c714206cf req-cb3c507f-ff3c-418f-b7b0-ecece8f1cf8d tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Flow 'volume_create_manager' (024f190c-21da-41b3-a824-0adad3cd51a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90c6375-41b5-4dcb-b86a-d8c948cc7b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90c6375-41b5-4dcb-b86a-d8c948cc7b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1738667277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35acfdf1-663e-4234-a07b-c1cb847d004c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e109be2a215c4ba290e747db29717097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:00Z,use_quota=True,user_id='4c768380ff334f5396cecfee9eceee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffda96a-149e-4653-b4da-78887a9451f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffda96a-149e-4653-b4da-78887a9451f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb2ac4e-0f14-41a2-8080-d7a369ec72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb2ac4e-0f14-41a2-8080-d7a369ec72b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35acfdf1-663e-4234-a07b-c1cb847d004c', 'volume_name': 'volume-35acfdf1-663e-4234-a07b-c1cb847d004c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b957b06-2f73-4dd2-8551-fefe0d43e1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b957b06-2f73-4dd2-8551-fefe0d43e1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26c71d8-a1fd-4791-a4e9-a74eed39a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Volume 35acfdf1-663e-4234-a07b-c1cb847d004c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35acfdf1-663e-4234-a07b-c1cb847d004c', 'volume_size': 1}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:00 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a 1073741824" returned: 0 in 1.051s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:00 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a
Jun 01 01:56:00 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:01 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" returned: 0 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-61b9abfd-2f51-429e-893b-fe6c714206cf req-cb3c507f-ff3c-418f-b7b0-ecece8f1cf8d tempest-TestStampPattern-2091375347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.461s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36735381-aa28-4c1c-b352-a2360f9e0eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0147226-76b7-432d-92dc-4be01eb29ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdbf5b5-263e-4f9e-806f-e5feb3751b13]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-61b9abfd-2f51-429e-893b-fe6c714206cf req-cb3c507f-ff3c-418f-b7b0-ecece8f1cf8d tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Volume volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a (6c23a92f-aacf-4ae0-97aa-d8f8e361532a): created successfully
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0147226-76b7-432d-92dc-4be01eb29ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Flow 'volume_create_manager' (5f11a8fe-7f9d-4e55-a5e0-869f198eab32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fb7c959e-4e34-43f0-88fb-69ab5943a788 tempest-VolumesDeleteCascade-886328931 None] Created volume successfully.
Jun 01 01:56:01 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06
Jun 01 01:56:01 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:02 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-61b9abfd-2f51-429e-893b-fe6c714206cf req-cb3c507f-ff3c-418f-b7b0-ecece8f1cf8d tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-61b9abfd-2f51-429e-893b-fe6c714206cf req-cb3c507f-ff3c-418f-b7b0-ecece8f1cf8d tempest-TestStampPattern-2091375347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1738667277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35acfdf1-663e-4234-a07b-c1cb847d004c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e109be2a215c4ba290e747db29717097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:00Z,use_quota=True,user_id='4c768380ff334f5396cecfee9eceee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Creating volume 35acfdf1-663e-4234-a07b-c1cb847d004c {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:56:02 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:02 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c 1073741824
Jun 01 01:56:02 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-61b9abfd-2f51-429e-893b-fe6c714206cf req-cb3c507f-ff3c-418f-b7b0-ecece8f1cf8d tempest-TestStampPattern-2091375347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11e94eed-4b7c-4361-b865-176e912d9067', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:56:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-61b9abfd-2f51-429e-893b-fe6c714206cf req-cb3c507f-ff3c-418f-b7b0-ecece8f1cf8d tempest-TestStampPattern-2091375347 None] attachment_update completed successfully.
Jun 01 01:56:03 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c 1073741824" returned: 0 in 0.951s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:03 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c
Jun 01 01:56:03 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:03 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.069s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Creating offline snapshot 83a627e2-96d9-41dd-9f49-082cd815ce2b of volume 6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26c71d8-a1fd-4791-a4e9-a74eed39a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35acfdf1-663e-4234-a07b-c1cb847d004c', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3d4074-fed6-4638-b6b5-6d07c1ddc658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2268c-4e72-4969-a5d7-7598792a9df6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:04 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Volume volume-35acfdf1-663e-4234-a07b-c1cb847d004c (35acfdf1-663e-4234-a07b-c1cb847d004c): created successfully
Jun 01 01:56:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3d4074-fed6-4638-b6b5-6d07c1ddc658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:04 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Flow 'volume_create_manager' (024f190c-21da-41b3-a824-0adad3cd51a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7da6fd65-9157-42cb-bdf4-fbb8edecb0a7 tempest-TestMinimumBasicScenario-372177162 None] Created volume successfully.
Jun 01 01:56:04 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a
Jun 01 01:56:04 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Acquiring lock "cinder-9582619c-20d4-45c6-8a34-26591c0e2dbf-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Lock "cinder-9582619c-20d4-45c6-8a34-26591c0e2dbf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Acquiring lock "cinder-quobyte-9582619c-20d4-45c6-8a34-26591c0e2dbf" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Lock "cinder-quobyte-9582619c-20d4-45c6-8a34-26591c0e2dbf" acquired by "delete_volume" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:05 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" returned: 0 in 1.015s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d442b09-3b86-4797-9ce9-bea5613f4891]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:05 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b 1G
Jun 01 01:56:05 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:05 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf
Jun 01 01:56:05 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:05 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b 1G" returned: 0 in 0.811s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:05 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf" returned: 0 in 0.822s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:05 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b
Jun 01 01:56:05 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:05 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf
Jun 01 01:56:05 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:06 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9582619c-20d4-45c6-8a34-26591c0e2dbf" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Lock "cinder-quobyte-9582619c-20d4-45c6-8a34-26591c0e2dbf" released by "delete_volume" :: held 1.608s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:06 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b" returned: 0 in 0.770s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:06 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b is being set with open permissions: ugo+rw
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:06 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b
Jun 01 01:56:06 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Created reservations ['a2e48c6e-fd94-41c7-8150-b84c5eed71ca', '14b5702b-96f7-466d-ba5b-dd921ba5e33f', '5b68a7ea-774e-48de-bf76-fd70f8585e8e', '2a9d6ccc-9cc0-45fc-80a9-928860e51567'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:06 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:56:06 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:07 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b" returned: 0 in 0.902s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:07 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.info
Jun 01 01:56:07 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:07 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.983s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:07 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:56:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Deleted volume successfully.
Jun 01 01:56:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-c9d86f5b-319b-4ed3-a6d1-3811f95f67ef tempest-VolumesNegativeTest-1077853005 None] Lock "cinder-9582619c-20d4-45c6-8a34-26591c0e2dbf-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7c2df55c-2e7b-44a8-be4a-e0e1bde32fb0 req-1fff6644-0179-482a-a8f1-e9a1a38c2b2e tempest-TestMinimumBasicScenario-372177162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:08 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.info" returned: 0 in 0.915s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:08 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.info is being set with open permissions: ugo+rw
Jun 01 01:56:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:08 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.info
Jun 01 01:56:08 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:09 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.info" returned: 0 in 0.939s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.520s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7c2df55c-2e7b-44a8-be4a-e0e1bde32fb0 req-1fff6644-0179-482a-a8f1-e9a1a38c2b2e tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:09 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab3c936-7522-4f69-8858-4279d26df391]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7c2df55c-2e7b-44a8-be4a-e0e1bde32fb0 req-1fff6644-0179-482a-a8f1-e9a1a38c2b2e tempest-TestMinimumBasicScenario-372177162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fb33df7c-6679-4bca-9627-99cb5c159441 tempest-VolumesDeleteCascade-886328931 None] Create snapshot completed successfully
Jun 01 01:56:09 devstack sudo[100768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c
Jun 01 01:56:09 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:10 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7c2df55c-2e7b-44a8-be4a-e0e1bde32fb0 req-1fff6644-0179-482a-a8f1-e9a1a38c2b2e tempest-TestMinimumBasicScenario-372177162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c" returned: 0 in 0.790s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7c2df55c-2e7b-44a8-be4a-e0e1bde32fb0 req-1fff6644-0179-482a-a8f1-e9a1a38c2b2e tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-7c2df55c-2e7b-44a8-be4a-e0e1bde32fb0 req-1fff6644-0179-482a-a8f1-e9a1a38c2b2e tempest-TestMinimumBasicScenario-372177162 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-35acfdf1-663e-4234-a07b-c1cb847d004c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97713734-db62-47d3-a4db-df575602cd26', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:56:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-7c2df55c-2e7b-44a8-be4a-e0e1bde32fb0 req-1fff6644-0179-482a-a8f1-e9a1a38c2b2e tempest-TestMinimumBasicScenario-372177162 None] attachment_update completed successfully.
Jun 01 01:56:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-ed9a81f8-8a52-4fc7-a81c-0ccc37595848 req-5591f667-55b6-40ba-a700-e219901008bf tempest-TestStampPattern-2091375347 None] Terminate volume connection completed successfully.
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-ed9a81f8-8a52-4fc7-a81c-0ccc37595848 req-5591f667-55b6-40ba-a700-e219901008bf tempest-TestStampPattern-2091375347 None] Deleting attachment 11e94eed-4b7c-4361-b865-176e912d9067. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Flow 'volume_create_manager' (a2cbfebf-0252-4378-9fdc-e0f7fcfc0055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5f474c-cb0c-444a-a934-5ac4d6f71bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5f474c-cb0c-444a-a934-5ac4d6f71bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-697245608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc3d7b6-bc55-4ef0-b049-a49663f70989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b3a77bd624d0a8720f977974a49ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83a627e2-96d9-41dd-9f49-082cd815ce2b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:11Z,use_quota=True,user_id='2b26a59e38724ada9107ef58b7d2007d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341d2993-b724-4d7e-ac35-aaa1dff438cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341d2993-b724-4d7e-ac35-aaa1dff438cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109c94eb-5465-4acf-bedf-2c9cca656ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109c94eb-5465-4acf-bedf-2c9cca656ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2bc3d7b6-bc55-4ef0-b049-a49663f70989', 'volume_name': 'volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989', 'volume_size': 1, 'snapshot_id': '83a627e2-96d9-41dd-9f49-082cd815ce2b'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b172d806-ceb8-4376-af71-94b9513fa32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b172d806-ceb8-4376-af71-94b9513fa32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a064c8-9234-4ae1-a9d9-3da72cc500e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Volume 2bc3d7b6-bc55-4ef0-b049-a49663f70989: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989', 'volume_size': 1, 'snapshot_id': '83a627e2-96d9-41dd-9f49-082cd815ce2b'}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-83a627e2-96d9-41dd-9f49-082cd815ce2b-2bc3d7b6-bc55-4ef0-b049-a49663f70989" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-83a627e2-96d9-41dd-9f49-082cd815ce2b-2bc3d7b6-bc55-4ef0-b049-a49663f70989" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Creating volume 2bc3d7b6-bc55-4ef0-b049-a49663f70989 from snapshot 83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-2bc3d7b6-bc55-4ef0-b049-a49663f70989" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-2bc3d7b6-bc55-4ef0-b049-a49663f70989" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] snapshot: 83a627e2-96d9-41dd-9f49-082cd815ce2b, volume: 2bc3d7b6-bc55-4ef0-b049-a49663f70989,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[89109f18-0e5b-4ad8-a116-00dd5e856050]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:11 devstack sudo[100846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b
Jun 01 01:56:11 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:11 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b" returned: 0 in 0.799s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9b5a91-825a-4c01-b26e-035b2da2a338]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:12 devstack sudo[101189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a
Jun 01 01:56:12 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:12 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:12 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:56:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:12 devstack sudo[101195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989
Jun 01 01:56:12 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Flow 'volume_create_manager' (8fc6ca63-6670-44f6-b49e-fde6a203a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dfcb3c-ab08-4ae7-becd-f5acc1573874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dfcb3c-ab08-4ae7-becd-f5acc1573874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88301ea6-7367-4644-a65a-e04d65efc798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c34aeec77e4ddd8d7af93842111179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:16Z,use_quota=True,user_id='615948c9d786469eab84f74e854913e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f09e99-9676-46f0-8df4-4e7b0ab04dba),volume_type_id=14f09e99-9676-46f0-8df4-4e7b0ab04dba)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa57a1b0-2da8-4c95-8588-0be803f753d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa57a1b0-2da8-4c95-8588-0be803f753d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfc9f0f-a5f1-4855-a26a-4c1b286912fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:16 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 01:56:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfc9f0f-a5f1-4855-a26a-4c1b286912fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '88301ea6-7367-4644-a65a-e04d65efc798', 'volume_name': 'volume-88301ea6-7367-4644-a65a-e04d65efc798', 'volume_size': 1, 'image_id': '1871ce67-6d80-454b-ab2f-3954070c2da2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1871ce67-6d80-454b-ab2f-3954070c2da2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1fe4e19bf481701dfd57b48b0c26e0b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60c34aeec77e4ddd8d7af93842111179', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3954931bfd3d771f1693f71ab249520e3a798ff300a0f679fb41302bfb0ae305427d59418439afdbf622d7d98e15c8b0e650b031c83406da6339607405b8988', 'id': '1871ce67-6d80-454b-ab2f-3954070c2da2', 'created_at': datetime.datetime(2026, 5, 31, 23, 56, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 56, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1871ce67-6d80-454b-ab2f-3954070c2da2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x728655afc350>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6f75fd-0c5a-4d70-861f-92b6aca88157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6f75fd-0c5a-4d70-861f-92b6aca88157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e034b2b9-9dfd-41c6-ae02-5a38c7fe454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Volume 88301ea6-7367-4644-a65a-e04d65efc798: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-88301ea6-7367-4644-a65a-e04d65efc798', 'volume_size': 1, 'image_id': '1871ce67-6d80-454b-ab2f-3954070c2da2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1871ce67-6d80-454b-ab2f-3954070c2da2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1fe4e19bf481701dfd57b48b0c26e0b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60c34aeec77e4ddd8d7af93842111179', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3954931bfd3d771f1693f71ab249520e3a798ff300a0f679fb41302bfb0ae305427d59418439afdbf622d7d98e15c8b0e650b031c83406da6339607405b8988', 'id': '1871ce67-6d80-454b-ab2f-3954070c2da2', 'created_at': datetime.datetime(2026, 5, 31, 23, 56, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 56, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1871ce67-6d80-454b-ab2f-3954070c2da2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x728655afc350>}
Jun 01 01:56:17 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Trying to clone 88301ea6-7367-4644-a65a-e04d65efc798 from image 1871ce67-6d80-454b-ab2f-3954070c2da2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1871ce67-6d80-454b-ab2f-3954070c2da2', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 01:56:18 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 01:56:18 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Image download 0.00 MB at 0.00 MB/s
Jun 01 01:56:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e8fd7-0676-4842-a288-4a3c2ad65706]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:18 devstack sudo[101246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD
Jun 01 01:56:18 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:20 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD" returned: 0 in 2.026s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:20 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989" returned: 0 in 7.817s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:20 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d571e6-c464-48f5-bf21-1aa008c365e8]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:20 devstack sudo[101250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD
Jun 01 01:56:20 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:20 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a
Jun 01 01:56:20 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:21 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD" returned: 1 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Temporary image 1871ce67-6d80-454b-ab2f-3954070c2da2 is fetched for user 615948c9d786469eab84f74e854913e8. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118a6e6-e890-4557-9279-6655e20f5ad1]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:21 devstack sudo[101260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD
Jun 01 01:56:21 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:21 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" returned: 0 in 1.039s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:56:21 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Converted 1024.00 MB image at 130.97 MB/s
Jun 01 01:56:21 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 is being set with open permissions: ugo+rw
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Lock "cinder-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:21 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989
Jun 01 01:56:21 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-quobyte-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb0431-8f54-4a4c-bfe8-7cec7e6359fa]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:22 devstack sudo[101265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06
Jun 01 01:56:22 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:22 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD" returned: 0 in 0.986s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:22 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989" returned: 0 in 0.843s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-2bc3d7b6-bc55-4ef0-b049-a49663f70989" released by "_copy_volume_from_snapshot" :: held 11.396s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-83a627e2-96d9-41dd-9f49-082cd815ce2b-2bc3d7b6-bc55-4ef0-b049-a49663f70989" released by "_create_volume_from_snapshot" :: held 11.440s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.483s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:22 devstack sudo[101271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD
Jun 01 01:56:22 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a064c8-9234-4ae1-a9d9-3da72cc500e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989', 'volume_size': 1, 'snapshot_id': '83a627e2-96d9-41dd-9f49-082cd815ce2b'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b577fe-39d1-41f5-91c2-784054cef1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:22 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Volume volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 (2bc3d7b6-bc55-4ef0-b049-a49663f70989): created successfully
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b577fe-39d1-41f5-91c2-784054cef1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Flow 'volume_create_manager' (a2cbfebf-0252-4378-9fdc-e0f7fcfc0055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ae894af1-a2f4-4e21-8af6-5c7e6cb81871 tempest-VolumesDeleteCascade-886328931 None] Created volume successfully.
Jun 01 01:56:22 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" returned: 0 in 1.156s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:22 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06
Jun 01 01:56:22 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:23 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD" returned: 1 in 0.894s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88301ea6-7367-4644-a65a-e04d65efc798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c34aeec77e4ddd8d7af93842111179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:16Z,use_quota=True,user_id='615948c9d786469eab84f74e854913e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f09e99-9676-46f0-8df4-4e7b0ab04dba),volume_type_id=14f09e99-9676-46f0-8df4-4e7b0ab04dba)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Creating volume 88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:56:23 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:23 devstack sudo[101282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 1073741824
Jun 01 01:56:23 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:23 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" returned: 0 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06" released by "delete_volume" :: held 2.051s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Created reservations ['6fb96b8b-1955-4239-a2cc-fc5efd559770', '4cbc5c3a-7a49-40a7-b54b-30d8199a26de', '489cbb78-04ed-4a46-aa55-7d44657981f0', '42d35036-0bca-4754-9e56-e0628349275d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-6c23a92f-aacf-4ae0-97aa-d8f8e361532a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-6c23a92f-aacf-4ae0-97aa-d8f8e361532a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:23 devstack sudo[101285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:56:23 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Performing cascade delete. {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}}
Jun 01 01:56:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-83a627e2-96d9-41dd-9f49-082cd815ce2b-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-83a627e2-96d9-41dd-9f49-082cd815ce2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-83a627e2-96d9-41dd-9f49-082cd815ce2b" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-83a627e2-96d9-41dd-9f49-082cd815ce2b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Deleting offline snapshot 83a627e2-96d9-41dd-9f49-082cd815ce2b of volume 6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] snapshot_file for this snap is: volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f56277-009a-424e-aa17-2bbd2377c47e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:24 devstack sudo[101290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b
Jun 01 01:56:24 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:24 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 1073741824" returned: 0 in 1.151s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:24 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798
Jun 01 01:56:24 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:24 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.757s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:56:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Deleted volume successfully.
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-05989619-c532-4da3-9886-19d4691bcdc8 tempest-TestStampPattern-2091375347 None] Lock "cinder-aa3fc935-e3b5-4ddc-8bf4-26bdb91fbe06-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:24 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b" returned: 0 in 0.840s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[df43c555-5fe2-4b79-bc45-ac49b9fae994]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:25 devstack sudo[101300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a
Jun 01 01:56:25 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:25 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Attempting download of 1871ce67-6d80-454b-ab2f-3954070c2da2 ((None, [{'url': 'file:///opt/stack/data/glance/images/1871ce67-6d80-454b-ab2f-3954070c2da2', 'metadata': {}}])) to volume 88301ea6-7367-4644-a65a-e04d65efc798. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-7525dca7-4b66-4353-bb94-bcad70db4357-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ba39dd-a50b-4fcc-a876-3167deab570d]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1871ce67-6d80-454b-ab2f-3954070c2da2_1ow2t9ll {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Lock "cinder-7525dca7-4b66-4353-bb94-bcad70db4357-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-quobyte-644bab3c-978d-4724-82c0-60662850bbf0" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-644bab3c-978d-4724-82c0-60662850bbf0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-quobyte-7525dca7-4b66-4353-bb94-bcad70db4357" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-7525dca7-4b66-4353-bb94-bcad70db4357" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Deleting offline snapshot 7525dca7-4b66-4353-bb94-bcad70db4357 of volume 644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] snapshot_file for this snap is: volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f05245-0c0b-4bb8-9ca3-7dc59a50b565]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:25 devstack sudo[101302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1871ce67-6d80-454b-ab2f-3954070c2da2_1ow2t9ll
Jun 01 01:56:25 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:25 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357
Jun 01 01:56:25 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:25 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" returned: 0 in 0.882s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:25 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b
Jun 01 01:56:25 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:26 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1871ce67-6d80-454b-ab2f-3954070c2da2_1ow2t9ll" returned: 0 in 0.936s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1871ce67-6d80-454b-ab2f-3954070c2da2_1ow2t9ll {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:26 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1871ce67-6d80-454b-ab2f-3954070c2da2_1ow2t9ll
Jun 01 01:56:26 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:26 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357" returned: 0 in 1.007s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-644bab3c-978d-4724-82c0-60662850bbf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ef23f0-0a24-4aad-9c02-256fdef67700]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:26 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:56:26 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:26 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b" returned: 0 in 0.906s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:26 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b
Jun 01 01:56:26 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:27 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1871ce67-6d80-454b-ab2f-3954070c2da2_1ow2t9ll" returned: 1 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1871ce67-6d80-454b-ab2f-3954070c2da2_1ow2t9ll' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98afd54-5b2f-4f8a-99c1-fcee07a21d2d]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:27 devstack sudo[101332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD
Jun 01 01:56:27 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:27 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 0.896s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:27 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357
Jun 01 01:56:27 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:27 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a.83a627e2-96d9-41dd-9f49-082cd815ce2b" returned: 0 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-83a627e2-96d9-41dd-9f49-082cd815ce2b" released by "_delete_snapshot" :: held 3.550s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" released by "delete_snapshot" :: held 3.585s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Created reservations ['a8048bff-f126-4a40-b500-c62c796d0aa7', '7a91517c-822c-411e-8c3c-1f04aa1b41ef', '1cebbf7b-789e-4956-9918-ab23a079d9a0', '50619685-ec0c-4ee4-b992-c478c96b83b4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Delete snapshot completed successfully.
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-83a627e2-96d9-41dd-9f49-082cd815ce2b-delete_snapshot" released by "delete_snapshot" :: held 3.745s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Snapshots deleted, issuing volume delete {{(pid=86676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f460c996-f014-4649-86b6-8339212b7d5b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:27 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:27 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a
Jun 01 01:56:27 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:27 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD
Jun 01 01:56:27 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:28 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:28 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357
Jun 01 01:56:28 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:28 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" returned: 0 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:28 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD" returned: 1 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] 1871ce67-6d80-454b-ab2f-3954070c2da2 was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:28 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a
Jun 01 01:56:28 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:28 devstack sudo[101361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798
Jun 01 01:56:28 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:28 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0.7525dca7-4b66-4353-bb94-bcad70db4357" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-7525dca7-4b66-4353-bb94-bcad70db4357" released by "_delete_snapshot" :: held 3.542s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-644bab3c-978d-4724-82c0-60662850bbf0" released by "delete_snapshot" :: held 3.570s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Created reservations ['8164a9f7-e617-4cae-8fe7-3b3e40aeadf4', 'd08b95c9-85ae-4934-9f1b-ef563092c8b9', 'd417f9c5-0c76-48b1-9d71-a59a86464ec2', 'f4d5f9f3-05ed-4b7e-aa6c-40e053eb125d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Delete snapshot completed successfully.
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2e22a30-c3a3-4a99-9f76-8c9397936769 tempest-TestStampPattern-2091375347 None] Lock "cinder-7525dca7-4b66-4353-bb94-bcad70db4357-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:29 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" returned: 0 in 0.665s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-6c23a92f-aacf-4ae0-97aa-d8f8e361532a" released by "delete_volume" :: held 1.500s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Created reservations ['77812b5e-7af5-48c4-818d-b5d4a4ac26fb', '1ea2cd48-e33d-40ab-8a18-11b7b4ab0985', 'caca2df5-4155-4292-98db-87dd3db96999', '09fb7b93-b4e2-4af5-9ef3-1e29580f9980'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:29 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798" returned: 0 in 0.813s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1871ce67-6d80-454b-ab2f-3954070c2da2_rfdnpe6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:56:29 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Converted 0.00 MB image at 0.00 MB/s
Jun 01 01:56:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:29 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:56:29 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:29 devstack sudo[101369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 1G
Jun 01 01:56:29 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:30 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.645s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:56:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Deleted volume successfully.
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-04f73fbf-01bc-477a-a432-afdda24f51bf tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-6c23a92f-aacf-4ae0-97aa-d8f8e361532a-delete_volume" released by "delete_volume" :: held 6.183s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:30 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 1G" returned: 0 in 0.726s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a5ce74-8d75-4b73-b969-78e95d0400de]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:30 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798
Jun 01 01:56:30 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-2bc3d7b6-bc55-4ef0-b049-a49663f70989-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-2bc3d7b6-bc55-4ef0-b049-a49663f70989-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "cinder-quobyte-2bc3d7b6-bc55-4ef0-b049-a49663f70989" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-2bc3d7b6-bc55-4ef0-b049-a49663f70989" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaede8b-6371-4598-aab3-c111fb69b8ce]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:30 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989
Jun 01 01:56:30 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:31 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798" returned: 0 in 0.885s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:31 devstack sudo[101409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798
Jun 01 01:56:31 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:31 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989" returned: 0 in 0.852s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:31 devstack sudo[101424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989
Jun 01 01:56:31 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:32 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798" returned: 1 in 0.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Downloaded image 1871ce67-6d80-454b-ab2f-3954070c2da2 ((None, [{'url': 'file:///opt/stack/data/glance/images/1871ce67-6d80-454b-ab2f-3954070c2da2', 'metadata': {}}])) to volume 88301ea6-7367-4644-a65a-e04d65efc798 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Temporary image 1871ce67-6d80-454b-ab2f-3954070c2da2 for user 615948c9d786469eab84f74e854913e8 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Marking volume 88301ea6-7367-4644-a65a-e04d65efc798 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Copying metadata from image 1871ce67-6d80-454b-ab2f-3954070c2da2 to 88301ea6-7367-4644-a65a-e04d65efc798. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Creating volume glance metadata for volume 88301ea6-7367-4644-a65a-e04d65efc798 backed by image 1871ce67-6d80-454b-ab2f-3954070c2da2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1871ce67-6d80-454b-ab2f-3954070c2da2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1fe4e19bf481701dfd57b48b0c26e0b2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e034b2b9-9dfd-41c6-ae02-5a38c7fe454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88301ea6-7367-4644-a65a-e04d65efc798', 'volume_size': 1, 'image_id': '1871ce67-6d80-454b-ab2f-3954070c2da2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1871ce67-6d80-454b-ab2f-3954070c2da2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1fe4e19bf481701dfd57b48b0c26e0b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60c34aeec77e4ddd8d7af93842111179', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3954931bfd3d771f1693f71ab249520e3a798ff300a0f679fb41302bfb0ae305427d59418439afdbf622d7d98e15c8b0e650b031c83406da6339607405b8988', 'id': '1871ce67-6d80-454b-ab2f-3954070c2da2', 'created_at': datetime.datetime(2026, 5, 31, 23, 56, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 56, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1871ce67-6d80-454b-ab2f-3954070c2da2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x728655afc350>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16765cb9-6dc7-4e90-860f-3455240c8302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Volume volume-88301ea6-7367-4644-a65a-e04d65efc798 (88301ea6-7367-4644-a65a-e04d65efc798): created successfully
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16765cb9-6dc7-4e90-860f-3455240c8302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Flow 'volume_create_manager' (8fc6ca63-6670-44f6-b49e-fde6a203a699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ed9066d3-5c0f-46c9-a2fd-e5ab31f7a4b6 tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Created volume successfully.
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Acquiring lock "cinder-88301ea6-7367-4644-a65a-e04d65efc798-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "cinder-88301ea6-7367-4644-a65a-e04d65efc798-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Acquiring lock "cinder-quobyte-88301ea6-7367-4644-a65a-e04d65efc798" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "cinder-quobyte-88301ea6-7367-4644-a65a-e04d65efc798" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6729ce35-3c09-496c-943a-ff09ed326273]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:32 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2bc3d7b6-bc55-4ef0-b049-a49663f70989" returned: 0 in 0.966s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-quobyte-2bc3d7b6-bc55-4ef0-b049-a49663f70989" released by "delete_volume" :: held 1.876s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Created reservations ['cf934205-7f78-47b8-9040-46c14df8d123', 'c4a27a15-86f3-4988-8599-9fd83efba173', '603a0354-668c-4808-8f87-d629a09f3afb', '47ae4ad4-82ea-4617-9cd5-382e49d0f191'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:32 devstack sudo[101460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798
Jun 01 01:56:32 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:32 devstack sudo[101462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:56:32 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:33 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798" returned: 0 in 0.901s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:33 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.812s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:33 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:56:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Deleted volume successfully.
Jun 01 01:56:33 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6f1ed07f-7e9a-4bd3-9c1b-72be72fddd74 tempest-VolumesDeleteCascade-886328931 None] Lock "cinder-2bc3d7b6-bc55-4ef0-b049-a49663f70989-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:33 devstack sudo[101468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798
Jun 01 01:56:33 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:34 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798" returned: 1 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:56:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:34 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798
Jun 01 01:56:34 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:35 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-88301ea6-7367-4644-a65a-e04d65efc798" returned: 0 in 0.955s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "cinder-quobyte-88301ea6-7367-4644-a65a-e04d65efc798" released by "delete_volume" :: held 2.815s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:35 devstack cinder-volume[86676]: WARNING cinder.quota [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:56:35 devstack cinder-volume[86676]: WARNING cinder.quota [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Created reservations ['4192ccbb-915c-4956-9c30-e07f263ad4f9', '312d4a09-e17c-4564-9bbe-873c2f96168d', '7ec660d1-f329-4b76-b772-4ba4ac49907c', 'c107a5df-4f96-4a2c-a4be-50508d8b277b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:35 devstack sudo[101483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:56:35 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:36 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:56:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Deleted volume successfully.
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4a6a35fc-693a-4878-8de4-ed32843fb4ed tempest-VolumeAndVolumeTypeFromImageTest-954969851 None] Lock "cinder-88301ea6-7367-4644-a65a-e04d65efc798-delete_volume" released by "delete_volume" :: held 3.747s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Flow 'volume_create_manager' (5e7a5e9b-ef00-40a9-8dfb-779b8b0a020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c3f1c7-7f33-4b71-9a53-fc875aad7f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c3f1c7-7f33-4b71-9a53-fc875aad7f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1643780263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecadbc717ae4044a1f150cc1d394adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:37Z,use_quota=True,user_id='6f39a479500b4dd1ad0c88568b2f977d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc50c51-ea6e-4443-b1f1-e36eb246c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc50c51-ea6e-4443-b1f1-e36eb246c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df4ed9a-fd79-4ada-b827-9b31220662ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df4ed9a-fd79-4ada-b827-9b31220662ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6', 'volume_name': 'volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab5e9d3-b6ed-4bb0-95ce-3e5568b50e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab5e9d3-b6ed-4bb0-95ce-3e5568b50e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777b6865-a105-4748-bbd6-1139bcabb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:36 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Volume 4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6', 'volume_size': 1}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1643780263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecadbc717ae4044a1f150cc1d394adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:37Z,use_quota=True,user_id='6f39a479500b4dd1ad0c88568b2f977d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Creating volume 4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:56:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:56:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:36 devstack sudo[101487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 1073741824
Jun 01 01:56:36 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-644bab3c-978d-4724-82c0-60662850bbf0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Lock "cinder-644bab3c-978d-4724-82c0-60662850bbf0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Acquiring lock "cinder-quobyte-644bab3c-978d-4724-82c0-60662850bbf0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-644bab3c-978d-4724-82c0-60662850bbf0" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f4f701-ee56-4bb0-b576-cfc9014e0fd0]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:37 devstack sudo[101492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:56:37 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:37 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 1073741824" returned: 0 in 0.940s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:37 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6
Jun 01 01:56:37 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:38 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 0.954s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:38 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0
Jun 01 01:56:38 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:38 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" returned: 0 in 0.699s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777b6865-a105-4748-bbd6-1139bcabb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3157736-fccb-4c02-8eff-588cbb183d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Volume volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 (4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6): created successfully
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3157736-fccb-4c02-8eff-588cbb183d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Flow 'volume_create_manager' (5e7a5e9b-ef00-40a9-8dfb-779b8b0a020f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2095c5e2-35b6-4f5f-bc89-7d9c1d48692f tempest-VolumesCloneTest-1690219813 None] Created volume successfully.
Jun 01 01:56:39 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-644bab3c-978d-4724-82c0-60662850bbf0" returned: 0 in 0.774s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Lock "cinder-quobyte-644bab3c-978d-4724-82c0-60662850bbf0" released by "delete_volume" :: held 1.817s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Created reservations ['d927c71b-9073-4a0e-8534-51c6b669f260', 'a474de9a-4a49-407b-9460-168b989ee33d', '1ac6481f-29b2-4f3c-a163-0a3c30f6a17a', 'de67dd43-77fd-4119-ab9b-ecb3be2eea86'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:39 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:56:39 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Flow 'volume_create_manager' (24786b79-69d8-4d4b-a158-afa67c74512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f19d8ad-c636-448f-ba46-95a442cd7744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f19d8ad-c636-448f-ba46-95a442cd7744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1155366456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04127067-c077-4180-8eb2-ff6c141aa2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecadbc717ae4044a1f150cc1d394adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:39Z,use_quota=True,user_id='6f39a479500b4dd1ad0c88568b2f977d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa1cd95-83f1-468a-ab0c-111ab9d4720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa1cd95-83f1-468a-ab0c-111ab9d4720d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87aa6883-df36-4558-938b-a395c3813e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87aa6883-df36-4558-938b-a395c3813e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '04127067-c077-4180-8eb2-ff6c141aa2f4', 'volume_name': 'volume-04127067-c077-4180-8eb2-ff6c141aa2f4', 'volume_size': 2, 'source_volid': '4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfce50a-656b-4366-9bfa-f29899dec623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfce50a-656b-4366-9bfa-f29899dec623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391d1033-22ef-4f04-9790-0de258351ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Volume 04127067-c077-4180-8eb2-ff6c141aa2f4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-04127067-c077-4180-8eb2-ff6c141aa2f4', 'volume_size': 2, 'source_volid': '4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6', 'source_volstatus': 'available'}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:39 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Cloning volume 4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 to volume 04127067-c077-4180-8eb2-ff6c141aa2f4
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Creating offline snapshot e886c64e-1621-46d9-a663-b787fc161b60 of volume 4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[656e076a-918c-498e-a633-4a57b68867aa]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:39 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6
Jun 01 01:56:39 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:40 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.941s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:40 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:56:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Deleted volume successfully.
Jun 01 01:56:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b55bbdd0-ddf9-4be7-8765-0b67b5025b86 tempest-TestStampPattern-2091375347 None] Lock "cinder-644bab3c-978d-4724-82c0-60662850bbf0-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:40 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" returned: 0 in 1.098s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:40 devstack sudo[101513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 1G
Jun 01 01:56:40 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=101,cinder:UPDATE=101,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=102,cinder:SELECT=92,cinder:DELETE=5,cinder:INSERT=27 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Flow 'volume_create_manager' (6fb7669f-b8ab-45c8-8809-76652baed7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218c7ade-4c72-4a2d-a3ba-bf7ae343ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218c7ade-4c72-4a2d-a3ba-bf7ae343ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-937287549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c95dbc1-d81f-4c6d-82c4-03433d935bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd698da8c5dc42fb813cd6843276e19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:41Z,use_quota=True,user_id='9c16f4cd63454220b718021cc9a2a433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f89bd73-2ae2-42e0-b665-dca07aa7636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f89bd73-2ae2-42e0-b665-dca07aa7636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c971e58-0985-4c86-9b54-b2e104223e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c971e58-0985-4c86-9b54-b2e104223e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c95dbc1-d81f-4c6d-82c4-03433d935bd9', 'volume_name': 'volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3411eb45-7d70-4be1-8677-9e01bae1f759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3411eb45-7d70-4be1-8677-9e01bae1f759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6eb58bf-75cf-4764-b426-b4e0190f7571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:41 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Volume 6c95dbc1-d81f-4c6d-82c4-03433d935bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9', 'volume_size': 1}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:41 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 1G" returned: 0 in 0.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:41 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60
Jun 01 01:56:41 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:42 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60" returned: 0 in 0.690s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:42 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 is being set with open permissions: ugo+rw
Jun 01 01:56:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:42 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60
Jun 01 01:56:42 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:43 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60" returned: 0 in 0.703s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:43 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.info
Jun 01 01:56:43 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:43 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.info" returned: 0 in 0.693s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:43 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.info is being set with open permissions: ugo+rw
Jun 01 01:56:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:43 devstack sudo[101571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.info
Jun 01 01:56:43 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:44 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.info" returned: 0 in 0.798s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Acquiring lock "cinder-quobyte-04127067-c077-4180-8eb2-ff6c141aa2f4" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-04127067-c077-4180-8eb2-ff6c141aa2f4" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] snapshot: e886c64e-1621-46d9-a663-b787fc161b60, volume: 04127067-c077-4180-8eb2-ff6c141aa2f4,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e1793-0e8f-4620-9386-acb118472508]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:44 devstack sudo[101615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60
Jun 01 01:56:44 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:45 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60" returned: 0 in 1.147s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:56:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:56:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:56:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf5219-3d5e-4961-b8de-227a9f5e43cc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:46 devstack sudo[101643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6
Jun 01 01:56:46 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:46 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" returned: 0 in 0.994s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:46 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:56:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:47 devstack sudo[101650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4
Jun 01 01:56:47 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:56:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:52 devstack sudo[101699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:56:52 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:53 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:56:53 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:56:54 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:56:54 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4" returned: 0 in 7.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d97e83-0484-43ed-b580-560ecf010ccb]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:54 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6
Jun 01 01:56:54 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:55 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" returned: 0 in 1.014s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:55 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:56:55 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Converted 1024.00 MB image at 130.96 MB/s
Jun 01 01:56:55 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4 is being set with open permissions: ugo+rw
Jun 01 01:56:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:55 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4
Jun 01 01:56:55 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:56 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4" returned: 0 in 0.666s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-04127067-c077-4180-8eb2-ff6c141aa2f4" released by "_copy_volume_from_snapshot" :: held 11.790s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Acquiring lock "cinder-quobyte-e886c64e-1621-46d9-a663-b787fc161b60" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-e886c64e-1621-46d9-a663-b787fc161b60" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Deleting offline snapshot e886c64e-1621-46d9-a663-b787fc161b60 of volume 4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] snapshot_file for this snap is: volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f60e92-3722-42b5-a3c5-b2c4f70466f9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:56 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60
Jun 01 01:56:56 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:57 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60" returned: 0 in 0.717s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:56:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac708cd-b2b8-493d-8ae4-18a7393ceb32]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:57 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6
Jun 01 01:56:57 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:58 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:58 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60
Jun 01 01:56:58 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:58 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:58 devstack sudo[101740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60
Jun 01 01:56:58 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:59 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6.e886c64e-1621-46d9-a663-b787fc161b60" returned: 0 in 0.606s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-e886c64e-1621-46d9-a663-b787fc161b60" released by "_delete_snapshot" :: held 2.881s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.775s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.907s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-937287549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c95dbc1-d81f-4c6d-82c4-03433d935bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd698da8c5dc42fb813cd6843276e19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:56:41Z,use_quota=True,user_id='9c16f4cd63454220b718021cc9a2a433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Creating volume 6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:56:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:56:59 devstack sudo[101743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 1073741824
Jun 01 01:56:59 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391d1033-22ef-4f04-9790-0de258351ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04127067-c077-4180-8eb2-ff6c141aa2f4', 'volume_size': 2, 'source_volid': '4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6', 'source_volstatus': 'available'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dcad9c-0d48-48bf-9ff6-221d96be18b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:56:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Volume volume-04127067-c077-4180-8eb2-ff6c141aa2f4 (04127067-c077-4180-8eb2-ff6c141aa2f4): created successfully
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dcad9c-0d48-48bf-9ff6-221d96be18b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Flow 'volume_create_manager' (24786b79-69d8-4d4b-a158-afa67c74512a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:56:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-955a9237-1083-4b11-959f-6161eb70d5da tempest-VolumesCloneTest-1690219813 None] Created volume successfully.
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Acquiring lock "cinder-04127067-c077-4180-8eb2-ff6c141aa2f4-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-04127067-c077-4180-8eb2-ff6c141aa2f4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Acquiring lock "cinder-quobyte-04127067-c077-4180-8eb2-ff6c141aa2f4" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-04127067-c077-4180-8eb2-ff6c141aa2f4" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ede8ab9-8a68-4762-bc50-99147af2ab06]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:56:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:00 devstack sudo[101745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4
Jun 01 01:57:00 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:00 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 1073741824" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:00 devstack sudo[101751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9
Jun 01 01:57:00 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:00 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4" returned: 0 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:00 devstack sudo[101756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4
Jun 01 01:57:00 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:00 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6eb58bf-75cf-4764-b426-b4e0190f7571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf0fdcc-ed6e-4cb1-80cc-6231b65883f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Volume volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 (6c95dbc1-d81f-4c6d-82c4-03433d935bd9): created successfully
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf0fdcc-ed6e-4cb1-80cc-6231b65883f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Flow 'volume_create_manager' (6fb7669f-b8ab-45c8-8809-76652baed7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2a64101f-6636-4306-a742-ef985e83e857 tempest-VolumeDependencyTests-762429687 None] Created volume successfully.
Jun 01 01:57:01 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-04127067-c077-4180-8eb2-ff6c141aa2f4" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-04127067-c077-4180-8eb2-ff6c141aa2f4" released by "delete_volume" :: held 1.454s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Created reservations ['c3822d73-ff50-4dd0-b542-9c7fc27f7056', '85cc27d0-2dae-4f7b-9b6a-b96a47f0f6e2', 'b66c45bc-396f-4b78-9773-1a3c822bfa5b', '08196606-0b2c-4ef8-a381-553ac9f09ea6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:01 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:01 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Creating offline snapshot d5738de5-30df-4771-852c-132e6eeac73f of volume 6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f29e8-bd0d-4394-9113-e9c4292fd9ec]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:02 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Deleted volume successfully.
Jun 01 01:57:02 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d6f05620-5c2c-4109-ae14-ffc0ad9e9cd2 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-04127067-c077-4180-8eb2-ff6c141aa2f4-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:02 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Acquiring lock "cinder-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Acquiring lock "cinder-quobyte-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b32dc7f-6e9d-4b47-8730-7be94a1467b2]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:02 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6
Jun 01 01:57:02 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:02 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:02 devstack sudo[101771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f 1G
Jun 01 01:57:02 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:03 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:03 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6
Jun 01 01:57:03 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:03 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f 1G" returned: 0 in 0.740s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:03 devstack sudo[101781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f
Jun 01 01:57:03 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:03 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-quobyte-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6" released by "delete_volume" :: held 1.447s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Created reservations ['7b1c792e-5f22-4e2b-9fda-fdef015c3a40', '8f2f3e84-7727-493b-81c8-427a434e789a', '3af96bd5-83c0-406e-8faf-85769202dc6b', '7b4d0896-2764-47bf-adc6-9478a322a0dc'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:03 devstack sudo[101784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:03 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:04 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f" returned: 0 in 0.653s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:04 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f is being set with open permissions: ugo+rw
Jun 01 01:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:04 devstack sudo[101789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f
Jun 01 01:57:04 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:04 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.652s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:04 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Deleted volume successfully.
Jun 01 01:57:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-b1d364ac-795d-4e9b-8adf-7883034979c5 tempest-VolumesCloneTest-1690219813 None] Lock "cinder-4d8f4a8a-3171-4dc4-8ecd-2d037d52d2f6-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:04 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f" returned: 0 in 0.637s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:04 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.info
Jun 01 01:57:04 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:05 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.info" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:05 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.info is being set with open permissions: ugo+rw
Jun 01 01:57:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:05 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.info
Jun 01 01:57:05 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:06 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.info" returned: 0 in 0.726s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.212s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:06 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1addd1f4-42f5-47e3-af65-338952540e08 tempest-VolumeDependencyTests-762429687 None] Create snapshot completed successfully
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Flow 'volume_create_manager' (9a9950b4-0803-4672-9348-69a272290973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37190fe-9cf4-4f65-b7ec-81f1bf2828eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37190fe-9cf4-4f65-b7ec-81f1bf2828eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048245955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd6548c-a860-4fbe-82e8-6df0896a3e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd698da8c5dc42fb813cd6843276e19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5738de5-30df-4771-852c-132e6eeac73f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:08Z,use_quota=True,user_id='9c16f4cd63454220b718021cc9a2a433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9117bfe4-4674-4a85-b86a-b0ece6d5602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9117bfe4-4674-4a85-b86a-b0ece6d5602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4b69c0-c0c4-4089-8315-0aae69359f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4b69c0-c0c4-4089-8315-0aae69359f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0bd6548c-a860-4fbe-82e8-6df0896a3e05', 'volume_name': 'volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05', 'volume_size': 1, 'snapshot_id': 'd5738de5-30df-4771-852c-132e6eeac73f'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104b6c3c-e8ec-4aca-852f-faa0fb6a8cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104b6c3c-e8ec-4aca-852f-faa0fb6a8cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929a867f-fb31-40e8-8666-06a11aa4903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:07 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Volume 0bd6548c-a860-4fbe-82e8-6df0896a3e05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05', 'volume_size': 1, 'snapshot_id': 'd5738de5-30df-4771-852c-132e6eeac73f'}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-quobyte-d5738de5-30df-4771-852c-132e6eeac73f-0bd6548c-a860-4fbe-82e8-6df0896a3e05" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-d5738de5-30df-4771-852c-132e6eeac73f-0bd6548c-a860-4fbe-82e8-6df0896a3e05" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Creating volume 0bd6548c-a860-4fbe-82e8-6df0896a3e05 from snapshot d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-quobyte-0bd6548c-a860-4fbe-82e8-6df0896a3e05" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-0bd6548c-a860-4fbe-82e8-6df0896a3e05" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] snapshot: d5738de5-30df-4771-852c-132e6eeac73f, volume: 0bd6548c-a860-4fbe-82e8-6df0896a3e05,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d941db-7437-43ab-9995-a1786d6656e0]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:08 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f
Jun 01 01:57:08 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:08 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f" returned: 0 in 0.879s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:57:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:57:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:57:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[70067072-8941-4df6-9469-0a8e2bfbe57f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:08 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9
Jun 01 01:57:08 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:09 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:09 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05
Jun 01 01:57:09 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (890f3ecd-4346-4b4d-aa1d-64ab6553e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052c1c42-1c08-4c90-ad08-454d8acd978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052c1c42-1c08-4c90-ad08-454d8acd978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1256962676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce27c49-3440-44d9-b52e-ae2c78383b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:10Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4590bf6a-79ac-4fa3-960b-b977070f1fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4590bf6a-79ac-4fa3-960b-b977070f1fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db83617d-cd70-4d80-94fe-c0704900c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db83617d-cd70-4d80-94fe-c0704900c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce27c49-3440-44d9-b52e-ae2c78383b38', 'volume_name': 'volume-2ce27c49-3440-44d9-b52e-ae2c78383b38', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a2ec8f-fe7f-4ef8-af6d-40e3e03771bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a2ec8f-fe7f-4ef8-af6d-40e3e03771bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd4d6f0-ba79-44f8-99e0-a953c930532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume 2ce27c49-3440-44d9-b52e-ae2c78383b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce27c49-3440-44d9-b52e-ae2c78383b38', 'volume_size': 1}
Jun 01 01:57:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-89097d90-d4b2-4ba8-a33b-fb6210c489d2 req-797ca516-d5a5-4626-8ec1-1bfbf4772413 tempest-TestMinimumBasicScenario-372177162 None] Terminate volume connection completed successfully.
Jun 01 01:57:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-89097d90-d4b2-4ba8-a33b-fb6210c489d2 req-797ca516-d5a5-4626-8ec1-1bfbf4772413 tempest-TestMinimumBasicScenario-372177162 None] Deleting attachment 97713734-db62-47d3-a4db-df575602cd26. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:57:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Acquiring lock "cinder-35acfdf1-663e-4234-a07b-c1cb847d004c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Lock "cinder-35acfdf1-663e-4234-a07b-c1cb847d004c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Acquiring lock "cinder-quobyte-35acfdf1-663e-4234-a07b-c1cb847d004c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:14 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Lock "cinder-quobyte-35acfdf1-663e-4234-a07b-c1cb847d004c" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db76ea0-3c60-4ddb-be69-e410056b5583]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:14 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c
Jun 01 01:57:14 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:15 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05" returned: 0 in 5.336s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[14359341-9183-4ee2-8e59-cb048636813c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:15 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9
Jun 01 01:57:15 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:15 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c" returned: 0 in 0.907s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:15 devstack sudo[101842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c
Jun 01 01:57:15 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:16 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" returned: 0 in 0.929s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:57:16 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Converted 1024.00 MB image at 191.85 MB/s
Jun 01 01:57:16 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 is being set with open permissions: ugo+rw
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:16 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-35acfdf1-663e-4234-a07b-c1cb847d004c" returned: 0 in 0.600s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:16 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05
Jun 01 01:57:16 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Lock "cinder-quobyte-35acfdf1-663e-4234-a07b-c1cb847d004c" released by "delete_volume" :: held 1.609s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Created reservations ['fb7316c6-0623-4ef8-8cff-f1236c568527', 'b622aff3-5fbf-48c2-9a05-a7105397801e', 'be22bbc7-94f3-431e-8aff-5a1564aec9ac', '5a0e3b54-45e1-4315-a62c-9195b20e73da'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:16 devstack sudo[101850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:16 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:16 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05" returned: 0 in 0.619s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-0bd6548c-a860-4fbe-82e8-6df0896a3e05" released by "_copy_volume_from_snapshot" :: held 8.801s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-d5738de5-30df-4771-852c-132e6eeac73f-0bd6548c-a860-4fbe-82e8-6df0896a3e05" released by "_create_volume_from_snapshot" :: held 8.846s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.879s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.776s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1256962676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce27c49-3440-44d9-b52e-ae2c78383b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:10Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Creating volume 2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:16 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:16 devstack sudo[101853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 1073741824
Jun 01 01:57:16 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929a867f-fb31-40e8-8666-06a11aa4903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05', 'volume_size': 1, 'snapshot_id': 'd5738de5-30df-4771-852c-132e6eeac73f'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ecfcb8-6f86-4693-ac16-2510405923a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Volume volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 (0bd6548c-a860-4fbe-82e8-6df0896a3e05): created successfully
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ecfcb8-6f86-4693-ac16-2510405923a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Flow 'volume_create_manager' (9a9950b4-0803-4672-9348-69a272290973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dd0f1bc4-3b33-487b-8ad2-12f90cc113ab tempest-VolumeDependencyTests-762429687 None] Created volume successfully.
Jun 01 01:57:16 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.620s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Deleted volume successfully.
Jun 01 01:57:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ed51fdce-dd89-45b4-bd08-5dafb1fbf18f tempest-TestMinimumBasicScenario-372177162 None] Lock "cinder-35acfdf1-663e-4234-a07b-c1cb847d004c-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:17 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 1073741824" returned: 0 in 0.808s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:17 devstack sudo[101859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38
Jun 01 01:57:17 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-d5738de5-30df-4771-852c-132e6eeac73f-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-d5738de5-30df-4771-852c-132e6eeac73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-quobyte-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-quobyte-d5738de5-30df-4771-852c-132e6eeac73f" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-d5738de5-30df-4771-852c-132e6eeac73f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Deleting offline snapshot d5738de5-30df-4771-852c-132e6eeac73f of volume 6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] snapshot_file for this snap is: volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8928ef-582d-49b2-80f0-acaf90a2892e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:18 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f
Jun 01 01:57:18 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:18 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38" returned: 0 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd4d6f0-ba79-44f8-99e0-a953c930532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce27c49-3440-44d9-b52e-ae2c78383b38', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a13df79-7ca8-4e66-8a67-658e5c5a7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 (2ce27c49-3440-44d9-b52e-ae2c78383b38): created successfully
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a13df79-7ca8-4e66-8a67-658e5c5a7b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (890f3ecd-4346-4b4d-aa1d-64ab6553e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b076c1f9-ba0e-4eef-9c67-ea789d8ee423 tempest-CreateVolumesFromSnapshotTest-978285108 None] Created volume successfully.
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Creating offline snapshot 1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 of volume 2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8a50d7-6adb-432f-887f-d95dbd9a68bc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:18 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f" returned: 0 in 1.002s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:57:18 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38
Jun 01 01:57:18 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[038061a0-28c9-49fd-bac5-d814a9ed27b6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:19 devstack sudo[101909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9
Jun 01 01:57:19 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:19 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38" returned: 0 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:19 devstack sudo[101916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 1G
Jun 01 01:57:19 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:19 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:19 devstack sudo[101919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f
Jun 01 01:57:19 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:20 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 1G" returned: 0 in 0.898s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:20 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8
Jun 01 01:57:20 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:20 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f" returned: 0 in 0.779s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:20 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f
Jun 01 01:57:20 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:21 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" returned: 0 in 0.684s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:21 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 is being set with open permissions: ugo+rw
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:21 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9.d5738de5-30df-4771-852c-132e6eeac73f" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:21 devstack sudo[101938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8
Jun 01 01:57:21 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-d5738de5-30df-4771-852c-132e6eeac73f" released by "_delete_snapshot" :: held 3.336s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" released by "delete_snapshot" :: held 3.368s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Created reservations ['bb64a9ee-c0a7-4d8f-b458-c843ce467118', '770a292e-d22a-43f3-9092-806abc80d848', 'b8e12e27-186a-4e7e-bad5-0c452da8a94f', 'a99f2513-b83f-46f0-b9f5-afc2d388434f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:21 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Delete snapshot completed successfully.
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5159b117-e079-4968-844a-db43dca77aa9 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-d5738de5-30df-4771-852c-132e6eeac73f-delete_snapshot" released by "delete_snapshot" :: held 3.516s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:21 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" returned: 0 in 0.585s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:21 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.info
Jun 01 01:57:21 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-6c95dbc1-d81f-4c6d-82c4-03433d935bd9-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-6c95dbc1-d81f-4c6d-82c4-03433d935bd9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-quobyte-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc49540-a4fc-473c-a1a2-c825711dc71a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:22 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9
Jun 01 01:57:22 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:22 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.info" returned: 0 in 0.663s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:22 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.info is being set with open permissions: ugo+rw
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:22 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.info
Jun 01 01:57:22 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:22 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:22 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9
Jun 01 01:57:22 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:23 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.info" returned: 0 in 0.622s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ff9866af-e4f0-4054-b4e2-b354d0511c0e tempest-CreateVolumesFromSnapshotTest-978285108 None] Create snapshot completed successfully
Jun 01 01:57:23 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-6c95dbc1-d81f-4c6d-82c4-03433d935bd9" released by "delete_volume" :: held 1.467s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Created reservations ['dd59318a-b282-47a7-a1b8-9514d3aa2789', '48b857f7-5441-4f17-bad0-466457c92c1e', '2b3f8ab5-a0ed-41f4-940d-279cda1390e4', '7faf91df-f987-4bf1-a7b8-a3a6b7c41930'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:23 devstack sudo[101955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:23 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-0bd6548c-a860-4fbe-82e8-6df0896a3e05-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-0bd6548c-a860-4fbe-82e8-6df0896a3e05-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "cinder-quobyte-0bd6548c-a860-4fbe-82e8-6df0896a3e05" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-0bd6548c-a860-4fbe-82e8-6df0896a3e05" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:24 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Deleted volume successfully.
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[459317b5-5289-4c89-9fcd-521ba623328d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bc4b83c3-fa26-4e5b-8ea6-ffcc5f4a4f72 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-6c95dbc1-d81f-4c6d-82c4-03433d935bd9-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:24 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05
Jun 01 01:57:24 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (67d6284f-06b7-4b5e-9ae5-6adcf942ed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f2cf3f-4e97-4c10-93d9-cbc2f395e622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f2cf3f-4e97-4c10-93d9-cbc2f395e622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1425038070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4866575a-5d7f-4515-83a7-674e2c2b8772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:25Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a03297-2497-4e02-811f-f696cca831d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a03297-2497-4e02-811f-f696cca831d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a423cd9-31c1-48b8-83f3-efea2aa8833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a423cd9-31c1-48b8-83f3-efea2aa8833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4866575a-5d7f-4515-83a7-674e2c2b8772', 'volume_name': 'volume-4866575a-5d7f-4515-83a7-674e2c2b8772', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c5cfd1-9f5a-416b-aa80-68d601a566f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c5cfd1-9f5a-416b-aa80-68d601a566f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c6e380-1ccc-41d2-b49e-5acd5b2ae3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume 4866575a-5d7f-4515-83a7-674e2c2b8772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4866575a-5d7f-4515-83a7-674e2c2b8772', 'volume_size': 1}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1425038070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4866575a-5d7f-4515-83a7-674e2c2b8772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:25Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Creating volume 4866575a-5d7f-4515-83a7-674e2c2b8772 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:24 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:57:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:24 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772 1073741824
Jun 01 01:57:24 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (d451ece6-9c59-4006-89bb-92b29bd2c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1820730-7ae3-4626-93b3-3cb41d61b52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1820730-7ae3-4626-93b3-3cb41d61b52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365553047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a45d4a9-1a6e-4a37-9ff3-4190b3939046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:25Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80de6422-c247-4ba6-b201-285a27b70f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80de6422-c247-4ba6-b201-285a27b70f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7129e6-cd74-46eb-8b26-3c5800e39cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7129e6-cd74-46eb-8b26-3c5800e39cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a45d4a9-1a6e-4a37-9ff3-4190b3939046', 'volume_name': 'volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42565c25-48bb-4b18-baac-c9fc817ddbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42565c25-48bb-4b18-baac-c9fc817ddbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a5c1a-e94e-4357-8908-6b6006d7ad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume 4a45d4a9-1a6e-4a37-9ff3-4190b3939046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046', 'volume_size': 1}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:25 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05" returned: 0 in 0.944s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:25 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05
Jun 01 01:57:25 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (366e320c-4c53-4f76-bbde-8213e2018ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b39489-a3b1-4f83-be77-04c5e4719c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b39489-a3b1-4f83-be77-04c5e4719c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1616582615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b517253f-81f0-4a4f-bf69-1663133b7ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:26Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdfb946-c662-4ca7-91ef-f35faa88b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdfb946-c662-4ca7-91ef-f35faa88b191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e957b9ac-283c-4665-bf12-2b8c45adf5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e957b9ac-283c-4665-bf12-2b8c45adf5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b517253f-81f0-4a4f-bf69-1663133b7ee9', 'volume_name': 'volume-b517253f-81f0-4a4f-bf69-1663133b7ee9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50cef1e8-3ef7-4302-b92d-2e9de53227ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50cef1e8-3ef7-4302-b92d-2e9de53227ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895ec1bb-2695-474f-bf2f-6556fa7b8356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume b517253f-81f0-4a4f-bf69-1663133b7ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b517253f-81f0-4a4f-bf69-1663133b7ee9', 'volume_size': 1}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (2fb291b8-097d-4f29-b7e7-8f3b7b28ebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd512504-be61-4fc8-ad5e-ef6ea81559b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd512504-be61-4fc8-ad5e-ef6ea81559b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120147608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d4cf06-76a4-423d-8e5b-b1bb920d8039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:26Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efbb5a8-bcec-47fa-8487-ee38b2e48474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efbb5a8-bcec-47fa-8487-ee38b2e48474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eda8b89-4d3f-4357-b264-0e0ee80f05d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eda8b89-4d3f-4357-b264-0e0ee80f05d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d4cf06-76a4-423d-8e5b-b1bb920d8039', 'volume_name': 'volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b30254-9b5c-4242-bdc1-4d28235e3f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b30254-9b5c-4242-bdc1-4d28235e3f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5798eb31-2d13-4b0f-b3a4-5c89e8a032b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume d8d4cf06-76a4-423d-8e5b-b1bb920d8039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039', 'volume_size': 1}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772 1073741824" returned: 0 in 1.329s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:26 devstack sudo[101971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772
Jun 01 01:57:26 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:26 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0bd6548c-a860-4fbe-82e8-6df0896a3e05" returned: 0 in 0.971s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-quobyte-0bd6548c-a860-4fbe-82e8-6df0896a3e05" released by "delete_volume" :: held 2.011s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (7599954d-04ba-41c4-9dae-feb0bf1fdf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfc5e38-2c1c-4c6a-8fe4-3f03fa8e73c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfc5e38-2c1c-4c6a-8fe4-3f03fa8e73c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1346611940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef80f411-ba2a-4502-b222-bc204116428f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:26Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f610b00d-af96-46fc-bea0-c75a7e735606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f610b00d-af96-46fc-bea0-c75a7e735606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d755dca-c310-4e36-9ff6-a59b44678058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d755dca-c310-4e36-9ff6-a59b44678058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef80f411-ba2a-4502-b222-bc204116428f', 'volume_name': 'volume-ef80f411-ba2a-4502-b222-bc204116428f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b976a0dd-d196-4220-a0a4-7008011a0a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b976a0dd-d196-4220-a0a4-7008011a0a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c824a2c-1976-427c-8350-552d4126637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume ef80f411-ba2a-4502-b222-bc204116428f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef80f411-ba2a-4502-b222-bc204116428f', 'volume_size': 1}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Created reservations ['41c72a20-69ed-45c0-b377-8ba6ea8da771', '0a62d3a0-e35f-4224-b4f2-bb8b136da009', 'd544a26f-384e-4b0b-8d60-f724fba154b8', 'd93ab0df-472e-4395-bf7b-3474f6f828cc'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:26 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:26 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:26 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772" returned: 0 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365553047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a45d4a9-1a6e-4a37-9ff3-4190b3939046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:25Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Creating volume 4a45d4a9-1a6e-4a37-9ff3-4190b3939046 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:26 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c6e380-1ccc-41d2-b49e-5acd5b2ae3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4866575a-5d7f-4515-83a7-674e2c2b8772', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba9f5ba-d5e3-4a5f-b966-03366940fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume volume-4866575a-5d7f-4515-83a7-674e2c2b8772 (4866575a-5d7f-4515-83a7-674e2c2b8772): created successfully
Jun 01 01:57:26 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046 1073741824
Jun 01 01:57:26 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba9f5ba-d5e3-4a5f-b966-03366940fc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (67d6284f-06b7-4b5e-9ae5-6adcf942ed59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7d616f7d-20f9-4632-a2cd-ab70ef5f73db tempest-CreateVolumesFromSnapshotTest-978285108 None] Created volume successfully.
Jun 01 01:57:27 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.702s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:27 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Deleted volume successfully.
Jun 01 01:57:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-ab37b324-25fb-4d50-be43-6aaf70f28508 tempest-VolumeDependencyTests-762429687 None] Lock "cinder-0bd6548c-a860-4fbe-82e8-6df0896a3e05-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:27 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046 1073741824" returned: 0 in 0.952s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:27 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046
Jun 01 01:57:27 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:28 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046" returned: 0 in 0.616s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.800s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1616582615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b517253f-81f0-4a4f-bf69-1663133b7ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:26Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Creating volume b517253f-81f0-4a4f-bf69-1663133b7ee9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:28 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:28 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9 1073741824
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a5c1a-e94e-4357-8908-6b6006d7ad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:28 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb85dd6-1bbf-4f53-9ad4-e70bfa74bc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046 (4a45d4a9-1a6e-4a37-9ff3-4190b3939046): created successfully
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb85dd6-1bbf-4f53-9ad4-e70bfa74bc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (d451ece6-9c59-4006-89bb-92b29bd2c939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ca0bbca2-38b6-4cf5-9023-a0be8e27369a tempest-CreateVolumesFromSnapshotTest-978285108 None] Created volume successfully.
Jun 01 01:57:29 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9 1073741824" returned: 0 in 0.896s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:29 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9
Jun 01 01:57:29 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:30 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.158s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120147608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d4cf06-76a4-423d-8e5b-b1bb920d8039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:26Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Creating volume d8d4cf06-76a4-423d-8e5b-b1bb920d8039 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:30 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895ec1bb-2695-474f-bf2f-6556fa7b8356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b517253f-81f0-4a4f-bf69-1663133b7ee9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:30 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039 1073741824
Jun 01 01:57:30 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1545b2d-06d4-453a-aff3-22c186666086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume volume-b517253f-81f0-4a4f-bf69-1663133b7ee9 (b517253f-81f0-4a4f-bf69-1663133b7ee9): created successfully
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1545b2d-06d4-453a-aff3-22c186666086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (366e320c-4c53-4f76-bbde-8213e2018ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7604dfe9-d289-4c21-8054-c2815ddf46b6 tempest-CreateVolumesFromSnapshotTest-978285108 None] Created volume successfully.
Jun 01 01:57:31 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039 1073741824" returned: 0 in 1.018s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:31 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039
Jun 01 01:57:31 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:31 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039" returned: 0 in 0.662s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.356s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1346611940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef80f411-ba2a-4502-b222-bc204116428f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f19dc52dc045b694ff21897cf4d535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:26Z,use_quota=True,user_id='ca49d1d7289044a49387e09f372d33bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Creating volume ef80f411-ba2a-4502-b222-bc204116428f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:31 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5798eb31-2d13-4b0f-b3a4-5c89e8a032b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:31 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f 1073741824
Jun 01 01:57:31 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab26b962-ff3c-4e85-8e2b-49d2b770b5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039 (d8d4cf06-76a4-423d-8e5b-b1bb920d8039): created successfully
Jun 01 01:57:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab26b962-ff3c-4e85-8e2b-49d2b770b5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (2fb291b8-097d-4f29-b7e7-8f3b7b28ebec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0f9e3a8f-2554-465c-916c-3e9839437439 tempest-CreateVolumesFromSnapshotTest-978285108 None] Created volume successfully.
Jun 01 01:57:32 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f 1073741824" returned: 0 in 0.922s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:32 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f
Jun 01 01:57:32 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:33 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f" returned: 0 in 0.785s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c824a2c-1976-427c-8350-552d4126637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef80f411-ba2a-4502-b222-bc204116428f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce053e5a-a208-4063-9f19-f6ba9d62c75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Volume volume-ef80f411-ba2a-4502-b222-bc204116428f (ef80f411-ba2a-4502-b222-bc204116428f): created successfully
Jun 01 01:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce053e5a-a208-4063-9f19-f6ba9d62c75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Flow 'volume_create_manager' (7599954d-04ba-41c4-9dae-feb0bf1fdf20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bbf866c7-d463-498c-8be3-29314b6e4ca8 tempest-CreateVolumesFromSnapshotTest-978285108 None] Created volume successfully.
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Flow 'volume_create_manager' (309bdbe5-66af-4afd-8a96-b4612cdb7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b8eef3-cfbd-4477-9199-3adb727869c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-ef80f411-ba2a-4502-b222-bc204116428f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b8eef3-cfbd-4477-9199-3adb727869c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162a74f9-b8ab-4bd3-9637-deeec9ab8b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38365e6a8a9c42749206d933f2be1691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:34Z,use_quota=True,user_id='1475cd69fe6844e3a8dde67527279d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a15d7a-8156-4e98-a7bd-652ae30abdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a15d7a-8156-4e98-a7bd-652ae30abdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a667b-1757-42fe-8a66-3db3d3610b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-ef80f411-ba2a-4502-b222-bc204116428f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-ef80f411-ba2a-4502-b222-bc204116428f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-ef80f411-ba2a-4502-b222-bc204116428f" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91482d2-daf2-4963-96e7-b68be2184ba5]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:34 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f
Jun 01 01:57:34 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a667b-1757-42fe-8a66-3db3d3610b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '162a74f9-b8ab-4bd3-9637-deeec9ab8b6b', 'volume_name': 'volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b', 'volume_size': 1, 'image_id': '4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd1f52a7af58f40116b3f1ea6b4b48f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38365e6a8a9c42749206d933f2be1691', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '382681757d13ff73e664403c3b845d2ee1a19f11ae643332574be4b4973608c1385d865192d237a35f11b02cb4d64e437a018fa748a21cf6c6959f75e5a679bf', 'id': '4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'created_at': datetime.datetime(2026, 5, 31, 23, 57, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 57, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b366930>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7aed9d-eadc-4286-9c25-ac2781d718af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7aed9d-eadc-4286-9c25-ac2781d718af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d573a12-4e1f-4e80-b49d-b5281b5ecf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Volume 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b', 'volume_size': 1, 'image_id': '4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd1f52a7af58f40116b3f1ea6b4b48f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38365e6a8a9c42749206d933f2be1691', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '382681757d13ff73e664403c3b845d2ee1a19f11ae643332574be4b4973608c1385d865192d237a35f11b02cb4d64e437a018fa748a21cf6c6959f75e5a679bf', 'id': '4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'created_at': datetime.datetime(2026, 5, 31, 23, 57, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 57, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b366930>}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Trying to clone 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b from image 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 01:57:34 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 01:57:34 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Image download 0.00 MB at 0.00 MB/s
Jun 01 01:57:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253259f-b36b-4c1c-b9ed-c995c61685c4]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:35 devstack sudo[102022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD
Jun 01 01:57:35 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:35 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:35 devstack sudo[102027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f
Jun 01 01:57:35 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:35 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:35 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-ef80f411-ba2a-4502-b222-bc204116428f" returned: 0 in 0.689s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-ef80f411-ba2a-4502-b222-bc204116428f" released by "delete_volume" :: held 1.515s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:36 devstack sudo[102032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD
Jun 01 01:57:36 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Created reservations ['11066aeb-90fc-45c2-8b5a-f9a96dfce8fc', '8ff4e9f8-6ed1-4de6-96ac-28502d34afc4', '23f51590-39a8-4cc6-96da-88366c8b6738', '9a56bed5-9832-4f5d-b34a-c7fca227ad7e'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:36 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:36 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-d8d4cf06-76a4-423d-8e5b-b1bb920d8039-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-d8d4cf06-76a4-423d-8e5b-b1bb920d8039-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:36 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Temporary image 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d is fetched for user 1475cd69fe6844e3a8dde67527279d5d. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-d8d4cf06-76a4-423d-8e5b-b1bb920d8039" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-d8d4cf06-76a4-423d-8e5b-b1bb920d8039" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35bad84-bcbe-4a67-9277-c0ea529a53e5]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb30cda-eee1-4d7e-b804-00d5a2e50864]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:36 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039
Jun 01 01:57:36 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:36 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.755s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Deleted volume successfully.
Jun 01 01:57:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-cd6aeebb-d2e7-493d-b0ac-4a829de2b66f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-ef80f411-ba2a-4502-b222-bc204116428f-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:37 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD
Jun 01 01:57:37 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:37 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039" returned: 0 in 0.777s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:37 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039
Jun 01 01:57:37 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:37 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:37 devstack sudo[102051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD
Jun 01 01:57:37 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:38 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d8d4cf06-76a4-423d-8e5b-b1bb920d8039" returned: 0 in 0.666s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-d8d4cf06-76a4-423d-8e5b-b1bb920d8039" released by "delete_volume" :: held 1.493s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Created reservations ['dde93566-f983-4feb-b7a8-3b1e681e4502', 'c75ff291-35c0-4fe2-9d58-2b0000e974e0', '306b7b24-01b3-4347-b4b5-a6e38339cc5e', 'bab8194c-cd88-48e6-8b65-d200f8b4723f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:38 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD" returned: 1 in 0.742s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162a74f9-b8ab-4bd3-9637-deeec9ab8b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38365e6a8a9c42749206d933f2be1691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:57:34Z,use_quota=True,user_id='1475cd69fe6844e3a8dde67527279d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Creating volume 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:57:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:38 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b 1073741824
Jun 01 01:57:38 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:38 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:38 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-b517253f-81f0-4a4f-bf69-1663133b7ee9-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-b517253f-81f0-4a4f-bf69-1663133b7ee9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-b517253f-81f0-4a4f-bf69-1663133b7ee9" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-b517253f-81f0-4a4f-bf69-1663133b7ee9" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f3e359-8493-41d3-a6f6-fd5b1b82f837]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:39 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.781s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Deleted volume successfully.
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d4478dc1-aa8b-4980-8e1e-2eb26537654b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-d8d4cf06-76a4-423d-8e5b-b1bb920d8039-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:39 devstack sudo[102066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9
Jun 01 01:57:39 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:39 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b 1073741824" returned: 0 in 0.984s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:39 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b
Jun 01 01:57:39 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:39 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9" returned: 0 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:39 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9
Jun 01 01:57:39 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:40 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" returned: 0 in 0.602s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Attempting download of 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'metadata': {}}])) to volume 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f5aaaa-dbcb-4959-af82-aa8ef2644f37]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_rdnhq02w {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:40 devstack sudo[102076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_rdnhq02w
Jun 01 01:57:40 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:40 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b517253f-81f0-4a4f-bf69-1663133b7ee9" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-b517253f-81f0-4a4f-bf69-1663133b7ee9" released by "delete_volume" :: held 1.538s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Created reservations ['4eee781b-0c10-4abf-85de-ea8857f7669f', '10adc259-5dbb-4cd4-994d-5a2c515c1299', 'c73457b5-6606-4841-86b8-77b9aab2ac68', '6c554c32-746f-400a-8fe3-506fa429a8e8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:40 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:40 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:40 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_rdnhq02w" returned: 0 in 0.836s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_rdnhq02w {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:41 devstack sudo[102084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_rdnhq02w
Jun 01 01:57:41 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-4a45d4a9-1a6e-4a37-9ff3-4190b3939046-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-4a45d4a9-1a6e-4a37-9ff3-4190b3939046-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-4a45d4a9-1a6e-4a37-9ff3-4190b3939046" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-4a45d4a9-1a6e-4a37-9ff3-4190b3939046" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[722155b7-2b2b-4b8e-b450-28cab90e68e9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:41 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.738s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Deleted volume successfully.
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-94c54d78-be65-4f95-91c1-effbf0fe747b tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-b517253f-81f0-4a4f-bf69-1663133b7ee9-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:41 devstack sudo[102087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046
Jun 01 01:57:41 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:41 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_rdnhq02w" returned: 1 in 0.963s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_rdnhq02w' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b256bf1c-83ae-4801-87a1-3f20492f7967]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:42 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD
Jun 01 01:57:42 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:42 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046" returned: 0 in 0.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:42 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046
Jun 01 01:57:42 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:42 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:42 devstack sudo[102101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD
Jun 01 01:57:42 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:43 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4a45d4a9-1a6e-4a37-9ff3-4190b3939046" returned: 0 in 0.787s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-4a45d4a9-1a6e-4a37-9ff3-4190b3939046" released by "delete_volume" :: held 1.734s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Created reservations ['8f969659-ebcd-420e-81ab-d2432c464bd7', '40b2677b-9567-401d-9fb6-3cba327fc29a', '0ef9c824-335c-4c9e-8980-dfe4dc577f98', '9a339576-a7b2-435e-bda4-674eb8d83eca'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:43 devstack sudo[102104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:43 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:43 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:43 devstack sudo[102109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b
Jun 01 01:57:43 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-4866575a-5d7f-4515-83a7-674e2c2b8772-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-4866575a-5d7f-4515-83a7-674e2c2b8772-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-4866575a-5d7f-4515-83a7-674e2c2b8772" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-4866575a-5d7f-4515-83a7-674e2c2b8772" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b7b99-7ed0-4731-94da-ac12cef93ea6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:43 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772
Jun 01 01:57:43 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:44 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.726s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Deleted volume successfully.
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8e9b5fbe-58d9-4b60-af2b-e369c7719a32 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-4a45d4a9-1a6e-4a37-9ff3-4190b3939046-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:44 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" returned: 0 in 0.807s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cc773b5-efc5-40a8-8fa5-ebf36b349f6d_j8nqmkdsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:57:44 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Converted 0.00 MB image at 0.00 MB/s
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:44 devstack sudo[102117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b 1G
Jun 01 01:57:44 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:44 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772" returned: 0 in 0.900s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:44 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772
Jun 01 01:57:44 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:45 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b 1G" returned: 0 in 0.780s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce8a1e-e995-4049-808a-b8eca0e52574]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:45 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b
Jun 01 01:57:45 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:45 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4866575a-5d7f-4515-83a7-674e2c2b8772" returned: 0 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-4866575a-5d7f-4515-83a7-674e2c2b8772" released by "delete_volume" :: held 1.761s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Created reservations ['f3195821-5b01-4c73-8027-4cfd14aba870', 'd64be496-ff2b-42aa-b261-cf277ef5e018', '31b42648-d708-4c05-9f2d-c0ae7628d160', '22f5cb2d-2f59-46eb-b6f0-d80b8dbbfb10'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:45 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:45 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-2ce27c49-3440-44d9-b52e-ae2c78383b38" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-2ce27c49-3440-44d9-b52e-ae2c78383b38" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Deleting offline snapshot 1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 of volume 2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] snapshot_file for this snap is: volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:57:46 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" returned: 0 in 0.904s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f67a22-94f2-4f58-9f35-0f870c52f765]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:46 devstack sudo[102136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8
Jun 01 01:57:46 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:46 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b
Jun 01 01:57:46 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:46 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.677s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Deleted volume successfully.
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8f818902-6719-4534-bc07-3b4ffd9b0d5f tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-4866575a-5d7f-4515-83a7-674e2c2b8772-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:46 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" returned: 1 in 0.810s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Downloaded image 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d ((None, [{'url': 'file:///opt/stack/data/glance/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'metadata': {}}])) to volume 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Temporary image 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d for user 1475cd69fe6844e3a8dde67527279d5d is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Marking volume 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 01:57:46 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" returned: 0 in 0.822s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce27c49-3440-44d9-b52e-ae2c78383b38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Copying metadata from image 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d to 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Creating volume glance metadata for volume 162a74f9-b8ab-4bd3-9637-deeec9ab8b6b backed by image 4cc773b5-efc5-40a8-8fa5-ebf36b349f6d with: {'image_id': '4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fd1f52a7af58f40116b3f1ea6b4b48f0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd1f6e-7691-4841-b01d-a53f86a17848]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d573a12-4e1f-4e80-b49d-b5281b5ecf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b', 'volume_size': 1, 'image_id': '4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd1f52a7af58f40116b3f1ea6b4b48f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38365e6a8a9c42749206d933f2be1691', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '382681757d13ff73e664403c3b845d2ee1a19f11ae643332574be4b4973608c1385d865192d237a35f11b02cb4d64e437a018fa748a21cf6c6959f75e5a679bf', 'id': '4cc773b5-efc5-40a8-8fa5-ebf36b349f6d', 'created_at': datetime.datetime(2026, 5, 31, 23, 57, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 57, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cc773b5-efc5-40a8-8fa5-ebf36b349f6d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b366930>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cef7815-f60a-4bad-8422-a4a8baf12e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:57:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Volume volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b (162a74f9-b8ab-4bd3-9637-deeec9ab8b6b): created successfully
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cef7815-f60a-4bad-8422-a4a8baf12e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Flow 'volume_create_manager' (309bdbe5-66af-4afd-8a96-b4612cdb7622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:57:47 devstack sudo[102146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38
Jun 01 01:57:47 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-ff6bcc3f-61c5-46a3-b0c2-05da537bb961 tempest-VolumeImageDependencyTests-655658598 None] Created volume successfully.
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Acquiring lock "cinder-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Lock "cinder-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Acquiring lock "cinder-quobyte-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Lock "cinder-quobyte-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c7c97a-eb9b-4244-8f2c-f418e51657e6]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:47 devstack sudo[102148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b
Jun 01 01:57:47 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:47 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38" returned: 0 in 0.857s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:47 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8
Jun 01 01:57:47 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:48 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" returned: 0 in 0.816s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:48 devstack sudo[102161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b
Jun 01 01:57:48 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:48 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:48 devstack sudo[102163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8
Jun 01 01:57:48 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:49 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" returned: 1 in 0.804s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:49 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38.1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" returned: 0 in 0.666s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:49 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b
Jun 01 01:57:49 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8" released by "_delete_snapshot" :: held 3.293s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-2ce27c49-3440-44d9-b52e-ae2c78383b38" released by "delete_snapshot" :: held 3.326s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Created reservations ['60ff284d-2a2d-4892-8dc7-681c9fd2a351', '0684cbdf-e4ca-47b7-9906-95da046701ab', 'cb1dbb40-76a5-4f27-9ead-1a897c8b2fad', 'b7405aaa-90e7-487f-a3cd-02fa81f157c9'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Delete snapshot completed successfully.
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9791deb5-ebba-4505-a143-0f069ee0fd90 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-1317f7a9-2f5c-425c-bd81-8fa9fe34d6e8-delete_snapshot" released by "delete_snapshot" :: held 3.515s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:49 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" returned: 0 in 0.624s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Lock "cinder-quobyte-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b" released by "delete_volume" :: held 2.313s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Created reservations ['5cbcd5d4-d4ad-441a-b0ee-e5b4a4999070', 'af2653fa-b36f-45b0-aa83-6c8cb3963817', 'd9f668f7-20b8-468b-b2d3-282e871bbd2c', '1f2a1990-e8e2-43af-8144-8bd13787352f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:50 devstack sudo[102172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:50 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-2ce27c49-3440-44d9-b52e-ae2c78383b38-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-2ce27c49-3440-44d9-b52e-ae2c78383b38-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "cinder-quobyte-2ce27c49-3440-44d9-b52e-ae2c78383b38" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-2ce27c49-3440-44d9-b52e-ae2c78383b38" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7448c844-c44f-48ab-8985-a1878f18d6fc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:50 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38
Jun 01 01:57:50 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:50 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:50 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Deleted volume successfully.
Jun 01 01:57:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6812ce1b-f296-4804-b0ff-18b50e3a045a tempest-VolumeImageDependencyTests-655658598 None] Lock "cinder-162a74f9-b8ab-4bd3-9637-deeec9ab8b6b-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:51 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38" returned: 0 in 0.923s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:51 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38
Jun 01 01:57:51 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:52 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2ce27c49-3440-44d9-b52e-ae2c78383b38" returned: 0 in 0.757s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-quobyte-2ce27c49-3440-44d9-b52e-ae2c78383b38" released by "delete_volume" :: held 1.749s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Created reservations ['ea8e4bbd-8f1b-4d05-b7a0-10309d897902', '1cf027f4-83cb-4dc7-847c-4df469da3137', 'e61b9e91-0883-47b7-84d0-fc47e6740d6c', 'f0908849-4060-4aa7-99e5-ed480c18e92f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:52 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:52 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:57:52 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:57:52 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:57:52 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.672s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:52 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:52 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Deleted volume successfully.
Jun 01 01:57:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f3de2294-e317-4fbf-a3df-6dfda86be791 tempest-CreateVolumesFromSnapshotTest-978285108 None] Lock "cinder-2ce27c49-3440-44d9-b52e-ae2c78383b38-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:57:53 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Jun 01 01:57:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.061s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:57:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:57:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:57:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:57:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:58:02 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=142,cinder:INSERT=40,cinder:SELECT=97,cinder:DELETE=9 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:58:02 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=139,cinder:SELECT=109,cinder:DELETE=15,cinder:INSERT=36 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Flow 'volume_create_manager' (9b566ac3-1ef0-415f-a18b-a2bc30b7f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a4f723-5530-44ed-a823-71f4010de408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a4f723-5530-44ed-a823-71f4010de408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1502568163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf9be24-43e0-43f8-94cf-28d5849b1040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b0911c8b9b41c68a49cae5069579bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:58:17Z,use_quota=True,user_id='7057286c9af94eb28f1886df31233a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d525c6dd-9942-4855-ac5f-215fe0f8efe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d525c6dd-9942-4855-ac5f-215fe0f8efe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dc3744-24fb-456e-a22d-ed9d9054c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dc3744-24fb-456e-a22d-ed9d9054c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf9be24-43e0-43f8-94cf-28d5849b1040', 'volume_name': 'volume-edf9be24-43e0-43f8-94cf-28d5849b1040', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23298a34-c1f7-4eae-afa2-beac167daa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23298a34-c1f7-4eae-afa2-beac167daa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fab5f5c-79ad-4bce-a0bd-ef9caffceefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Volume edf9be24-43e0-43f8-94cf-28d5849b1040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf9be24-43e0-43f8-94cf-28d5849b1040', 'volume_size': 1}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1502568163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf9be24-43e0-43f8-94cf-28d5849b1040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b0911c8b9b41c68a49cae5069579bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:58:17Z,use_quota=True,user_id='7057286c9af94eb28f1886df31233a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Creating volume edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:58:17 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:17 devstack sudo[102324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 1073741824
Jun 01 01:58:17 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:17 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 1073741824" returned: 0 in 0.847s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:18 devstack sudo[102330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040
Jun 01 01:58:18 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:18 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040" returned: 0 in 0.641s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fab5f5c-79ad-4bce-a0bd-ef9caffceefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf9be24-43e0-43f8-94cf-28d5849b1040', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36cd748-1e74-47dc-9c8b-4b02920d8939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Volume volume-edf9be24-43e0-43f8-94cf-28d5849b1040 (edf9be24-43e0-43f8-94cf-28d5849b1040): created successfully
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36cd748-1e74-47dc-9c8b-4b02920d8939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Flow 'volume_create_manager' (9b566ac3-1ef0-415f-a18b-a2bc30b7f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:58:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a13199ae-db7a-4148-b0c0-0dd01e1f116e tempest-SnapshotDependencyTests-1751719267 None] Created volume successfully.
Jun 01 01:58:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:19 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Creating offline snapshot c5a80116-d8ff-411f-8a07-da6273e72ca6 of volume edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 01:58:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f25ec52-4d9d-4274-8e5b-280a7c8c3213]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:19 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040
Jun 01 01:58:19 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:20 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:20 devstack sudo[102338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 1G
Jun 01 01:58:20 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:20 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 1G" returned: 0 in 0.765s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf9be24-43e0-43f8-94cf-28d5849b1040 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:20 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf9be24-43e0-43f8-94cf-28d5849b1040 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6
Jun 01 01:58:20 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:21 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf9be24-43e0-43f8-94cf-28d5849b1040 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6" returned: 0 in 0.681s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:21 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 is being set with open permissions: ugo+rw
Jun 01 01:58:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:21 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6
Jun 01 01:58:21 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:22 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6" returned: 0 in 0.597s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:22 devstack sudo[102354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.info
Jun 01 01:58:22 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:22 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.info" returned: 0 in 0.603s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:22 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.info is being set with open permissions: ugo+rw
Jun 01 01:58:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:22 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.info
Jun 01 01:58:22 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:23 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.info" returned: 0 in 0.586s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.043s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-cfe9a425-78c7-49e1-b586-186d7323eedd tempest-SnapshotDependencyTests-1751719267 None] Create snapshot completed successfully
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Flow 'volume_create_manager' (307839af-6465-4709-8cc6-bbb37f5dea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cf47a1-400d-44a4-b32b-89c3ee07714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cf47a1-400d-44a4-b32b-89c3ee07714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115c8a09-03f7-4ba3-a40d-91053f1aa23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b0911c8b9b41c68a49cae5069579bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5a80116-d8ff-411f-8a07-da6273e72ca6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:58:24Z,use_quota=True,user_id='7057286c9af94eb28f1886df31233a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8247b3d-757d-49de-b4e6-a4f91ef9d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8247b3d-757d-49de-b4e6-a4f91ef9d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efb6db9-7d42-421d-b109-f24a3c5916f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efb6db9-7d42-421d-b109-f24a3c5916f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '115c8a09-03f7-4ba3-a40d-91053f1aa23c', 'volume_name': 'volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c', 'volume_size': 1, 'snapshot_id': 'c5a80116-d8ff-411f-8a07-da6273e72ca6'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33ba370-629b-4a51-aba8-c43a59d9fcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33ba370-629b-4a51-aba8-c43a59d9fcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ef647b-f0a9-4770-9722-a64760d1433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:24 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Volume 115c8a09-03f7-4ba3-a40d-91053f1aa23c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c', 'volume_size': 1, 'snapshot_id': 'c5a80116-d8ff-411f-8a07-da6273e72ca6'}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-quobyte-c5a80116-d8ff-411f-8a07-da6273e72ca6-115c8a09-03f7-4ba3-a40d-91053f1aa23c" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-c5a80116-d8ff-411f-8a07-da6273e72ca6-115c8a09-03f7-4ba3-a40d-91053f1aa23c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Creating volume 115c8a09-03f7-4ba3-a40d-91053f1aa23c from snapshot c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-quobyte-115c8a09-03f7-4ba3-a40d-91053f1aa23c" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-115c8a09-03f7-4ba3-a40d-91053f1aa23c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] snapshot: c5a80116-d8ff-411f-8a07-da6273e72ca6, volume: 115c8a09-03f7-4ba3-a40d-91053f1aa23c,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d34865-f497-4082-b21d-190f3f29623c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:24 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6
Jun 01 01:58:24 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:24 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edf9be24-43e0-43f8-94cf-28d5849b1040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2dd584-b8ee-40b9-93cc-cf1ef65781af]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:25 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040
Jun 01 01:58:25 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:25 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040" returned: 0 in 0.720s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:25 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 01:58:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:25 devstack sudo[102370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c
Jun 01 01:58:25 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:30 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c" returned: 0 in 4.577s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f9fbd3-5200-4662-99b5-f014fafee22b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:30 devstack sudo[102403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040
Jun 01 01:58:30 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:31 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040" returned: 0 in 0.881s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 01:58:31 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Converted 1024.00 MB image at 223.64 MB/s
Jun 01 01:58:31 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c is being set with open permissions: ugo+rw
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:31 devstack sudo[102410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c
Jun 01 01:58:31 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:31 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c" returned: 0 in 0.589s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-115c8a09-03f7-4ba3-a40d-91053f1aa23c" released by "_copy_volume_from_snapshot" :: held 7.555s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-c5a80116-d8ff-411f-8a07-da6273e72ca6-115c8a09-03f7-4ba3-a40d-91053f1aa23c" released by "_create_volume_from_snapshot" :: held 7.587s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.604s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ef647b-f0a9-4770-9722-a64760d1433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c', 'volume_size': 1, 'snapshot_id': 'c5a80116-d8ff-411f-8a07-da6273e72ca6'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6414f15-05db-4699-b7a5-7fc04d69a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:31 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Volume volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c (115c8a09-03f7-4ba3-a40d-91053f1aa23c): created successfully
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6414f15-05db-4699-b7a5-7fc04d69a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Flow 'volume_create_manager' (307839af-6465-4709-8cc6-bbb37f5dea86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:58:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d8a244d2-1db9-4ff0-b41f-d01c04191241 tempest-SnapshotDependencyTests-1751719267 None] Created volume successfully.
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-c5a80116-d8ff-411f-8a07-da6273e72ca6-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-c5a80116-d8ff-411f-8a07-da6273e72ca6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-quobyte-edf9be24-43e0-43f8-94cf-28d5849b1040" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-edf9be24-43e0-43f8-94cf-28d5849b1040" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-quobyte-c5a80116-d8ff-411f-8a07-da6273e72ca6" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-c5a80116-d8ff-411f-8a07-da6273e72ca6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Deleting offline snapshot c5a80116-d8ff-411f-8a07-da6273e72ca6 of volume edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] snapshot_file for this snap is: volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f15210-b696-485f-9fc0-c39ab0b0bc7b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:32 devstack sudo[102413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6
Jun 01 01:58:32 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:33 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6" returned: 0 in 0.727s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:33 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edf9be24-43e0-43f8-94cf-28d5849b1040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 01:58:33 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef2a56-a2cb-4fbb-bf34-0665512e4cb6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:33 devstack sudo[102419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040
Jun 01 01:58:33 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:34 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:34 devstack sudo[102424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6
Jun 01 01:58:34 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:34 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6" returned: 0 in 0.718s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:34 devstack sudo[102436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6
Jun 01 01:58:34 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:35 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040.c5a80116-d8ff-411f-8a07-da6273e72ca6" returned: 0 in 0.585s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-c5a80116-d8ff-411f-8a07-da6273e72ca6" released by "_delete_snapshot" :: held 2.820s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-edf9be24-43e0-43f8-94cf-28d5849b1040" released by "delete_snapshot" :: held 2.841s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Created reservations ['8a38d450-6bd4-416f-a85b-20a87d056e96', '25f7cd0d-e63e-446a-abd0-9d661f93df54', '4054c0ab-f3d4-48d5-8396-40ed1554d184', '508a4c26-5027-44e4-8a03-3c3c2edaebb2'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:58:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Delete snapshot completed successfully.
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-554e4da4-773c-454b-8ad9-d0cb5f7d3a55 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-c5a80116-d8ff-411f-8a07-da6273e72ca6-delete_snapshot" released by "delete_snapshot" :: held 2.971s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-edf9be24-43e0-43f8-94cf-28d5849b1040-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-edf9be24-43e0-43f8-94cf-28d5849b1040-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-quobyte-edf9be24-43e0-43f8-94cf-28d5849b1040" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-edf9be24-43e0-43f8-94cf-28d5849b1040" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530f1c3-db52-411f-88f3-d52de33a6d65]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:36 devstack sudo[102440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040
Jun 01 01:58:36 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:36 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040" returned: 0 in 0.682s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:36 devstack sudo[102445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040
Jun 01 01:58:36 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:37 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-edf9be24-43e0-43f8-94cf-28d5849b1040" returned: 0 in 0.589s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-edf9be24-43e0-43f8-94cf-28d5849b1040" released by "delete_volume" :: held 1.326s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Created reservations ['33aef10f-7417-42cc-b144-e39bc241fbbd', 'a5d83165-fd3e-487b-9a8e-229c983d9177', '25258b57-97fd-426e-90d8-0e5e187790a3', '2263d23b-e4ff-4b73-be96-016797a930e0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:37 devstack sudo[102450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:58:37 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:38 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.620s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:58:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Deleted volume successfully.
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8fa09af0-34e0-482b-b606-1638f87e3308 tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-edf9be24-43e0-43f8-94cf-28d5849b1040-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-115c8a09-03f7-4ba3-a40d-91053f1aa23c-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-115c8a09-03f7-4ba3-a40d-91053f1aa23c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "cinder-quobyte-115c8a09-03f7-4ba3-a40d-91053f1aa23c" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-115c8a09-03f7-4ba3-a40d-91053f1aa23c" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[21302544-d1bd-4213-863e-7efa4522347a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Flow 'volume_create_manager' (c49ec1ec-f896-458a-93ec-94c4839ef8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bd49fa-a1c5-411d-9c45-cc34871098cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bd49fa-a1c5-411d-9c45-cc34871098cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1547144399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40db7e1f-a82b-4c89-b254-28204d878554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f93258e9cd48dcb644ac6646b909d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:58:38Z,use_quota=True,user_id='e327bde52a184787a1b41445c48470f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c512bce4-7d78-42e3-b5c5-1d240f42fca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c512bce4-7d78-42e3-b5c5-1d240f42fca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2637a3cf-ea31-4470-bbc4-fbb525ea01fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2637a3cf-ea31-4470-bbc4-fbb525ea01fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40db7e1f-a82b-4c89-b254-28204d878554', 'volume_name': 'volume-40db7e1f-a82b-4c89-b254-28204d878554', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265996a7-bfb4-460b-93fd-f833862def5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265996a7-bfb4-460b-93fd-f833862def5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6b9205-10a6-42d5-b1dc-22f5392efd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Volume 40db7e1f-a82b-4c89-b254-28204d878554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40db7e1f-a82b-4c89-b254-28204d878554', 'volume_size': 1}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1547144399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40db7e1f-a82b-4c89-b254-28204d878554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f93258e9cd48dcb644ac6646b909d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:58:38Z,use_quota=True,user_id='e327bde52a184787a1b41445c48470f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Creating volume 40db7e1f-a82b-4c89-b254-28204d878554 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:38 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c
Jun 01 01:58:38 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:58:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:38 devstack sudo[102455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554 1073741824
Jun 01 01:58:38 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:38 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c" returned: 0 in 0.699s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:38 devstack sudo[102463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c
Jun 01 01:58:38 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:39 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554 1073741824" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:39 devstack sudo[102466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554
Jun 01 01:58:39 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:39 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-115c8a09-03f7-4ba3-a40d-91053f1aa23c" returned: 0 in 0.608s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-quobyte-115c8a09-03f7-4ba3-a40d-91053f1aa23c" released by "delete_volume" :: held 1.352s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Created reservations ['b7ed737f-dc2a-4074-b4f8-f8f58bfc6b69', '275a1258-b181-4f75-bafc-1f6035b0bdd3', '4c0fd366-0907-4da4-b4b6-272fea4ba8f5', '8e40bea5-13af-486f-abb2-cc32052ae68f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:39 devstack sudo[102469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:58:39 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:39 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6b9205-10a6-42d5-b1dc-22f5392efd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40db7e1f-a82b-4c89-b254-28204d878554', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fbb788-8ef8-4bb3-902c-029c8e988954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:58:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Volume volume-40db7e1f-a82b-4c89-b254-28204d878554 (40db7e1f-a82b-4c89-b254-28204d878554): created successfully
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fbb788-8ef8-4bb3-902c-029c8e988954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:58:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Flow 'volume_create_manager' (c49ec1ec-f896-458a-93ec-94c4839ef8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:58:39 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-91cc037a-41ea-4d08-9092-78286768c9e0 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Created volume successfully.
Jun 01 01:58:40 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.598s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:40 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:58:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Deleted volume successfully.
Jun 01 01:58:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4d65b54b-f4fe-4e7b-88d0-5fa56895863a tempest-SnapshotDependencyTests-1751719267 None] Lock "cinder-115c8a09-03f7-4ba3-a40d-91053f1aa23c-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-e257fa1d-3629-406d-8119-af68f4a373cd req-734e3865-e0fb-4e39-9fec-a1f406d9ddc8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-e257fa1d-3629-406d-8119-af68f4a373cd req-734e3865-e0fb-4e39-9fec-a1f406d9ddc8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d191208a-ff93-4c51-a1cf-63394fc95491]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-e257fa1d-3629-406d-8119-af68f4a373cd req-734e3865-e0fb-4e39-9fec-a1f406d9ddc8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:43 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554
Jun 01 01:58:43 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:44 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-e257fa1d-3629-406d-8119-af68f4a373cd req-734e3865-e0fb-4e39-9fec-a1f406d9ddc8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-e257fa1d-3629-406d-8119-af68f4a373cd req-734e3865-e0fb-4e39-9fec-a1f406d9ddc8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-e257fa1d-3629-406d-8119-af68f4a373cd req-734e3865-e0fb-4e39-9fec-a1f406d9ddc8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-40db7e1f-a82b-4c89-b254-28204d878554', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ae2b5c7-9c66-4c83-9013-93a67b986f2b', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 01:58:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-e257fa1d-3629-406d-8119-af68f4a373cd req-734e3865-e0fb-4e39-9fec-a1f406d9ddc8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] attachment_update completed successfully.
Jun 01 01:58:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-df625f47-0fe1-4188-9186-87c2ca7201d6 req-51a7c80e-2bd5-4ea1-ab14-78666561ba22 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Terminate volume connection completed successfully.
Jun 01 01:58:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-df625f47-0fe1-4188-9186-87c2ca7201d6 req-51a7c80e-2bd5-4ea1-ab14-78666561ba22 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Deleting attachment 8ae2b5c7-9c66-4c83-9013-93a67b986f2b. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 01:58:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:58:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:52 devstack sudo[102903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:58:52 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:53 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.617s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Acquiring lock "cinder-40db7e1f-a82b-4c89-b254-28204d878554-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "cinder-40db7e1f-a82b-4c89-b254-28204d878554-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Acquiring lock "cinder-quobyte-40db7e1f-a82b-4c89-b254-28204d878554" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "cinder-quobyte-40db7e1f-a82b-4c89-b254-28204d878554" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a5f9de-543d-4b6f-9172-3df40ecbb1a9]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 01:58:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:53 devstack sudo[102907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554
Jun 01 01:58:53 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:54 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:54 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554
Jun 01 01:58:54 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:54 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-40db7e1f-a82b-4c89-b254-28204d878554" returned: 0 in 0.583s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "cinder-quobyte-40db7e1f-a82b-4c89-b254-28204d878554" released by "delete_volume" :: held 1.339s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Created reservations ['4b796053-19bd-4157-a461-f936ef70e702', '627cb1d2-cead-45f1-b179-bd0d22fd18e4', '7205910d-f909-4714-abb9-cebf945e3d84', 'b039f097-3d62-4ade-8a94-262301ff3dc1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:58:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:58:54 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:58:54 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:58:55 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Jun 01 01:58:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.575s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:58:55 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:58:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Deleted volume successfully.
Jun 01 01:58:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e160d8fc-2d63-4de5-b90c-f7addabf50c8 tempest-TestServerVolumeAttachScenarioOldVersion-2094045508 None] Lock "cinder-40db7e1f-a82b-4c89-b254-28204d878554-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 01:59:04 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=41,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=5 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:59:05 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=47,cinder:SELECT=34,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:59:26 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Flow 'volume_create_manager' (e0f04afc-64cc-462e-a83b-f9a61146e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06feca7-87c6-408b-83b6-92eb0ebdf38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06feca7-87c6-408b-83b6-92eb0ebdf38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-104789711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e136c3-e538-4c47-8fa3-99d8eb8738bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35805d48a6b46e0a18ad99be2247291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:59:27Z,use_quota=True,user_id='a47faf0bffe742a6b4d2135342b1a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cdd717-4888-4416-876f-837c1dc9fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cdd717-4888-4416-876f-837c1dc9fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb465cf5-de9a-4021-b00f-f2b04c183cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb465cf5-de9a-4021-b00f-f2b04c183cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e136c3-e538-4c47-8fa3-99d8eb8738bc', 'volume_name': 'volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1b1c6a-91bd-471b-b312-49ab5be1b3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1b1c6a-91bd-471b-b312-49ab5be1b3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cca1de4-161a-49c5-89d3-4e40a66429c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Volume b6e136c3-e538-4c47-8fa3-99d8eb8738bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc', 'volume_size': 1}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-104789711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e136c3-e538-4c47-8fa3-99d8eb8738bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35805d48a6b46e0a18ad99be2247291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:59:27Z,use_quota=True,user_id='a47faf0bffe742a6b4d2135342b1a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Creating volume b6e136c3-e538-4c47-8fa3-99d8eb8738bc {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:59:27 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:59:27 devstack sudo[103012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc 1073741824
Jun 01 01:59:27 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Flow 'volume_create_manager' (73ba9bb1-33af-459f-8091-ea43031a24c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245f7828-38ef-434b-a476-5d8dc19c3e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245f7828-38ef-434b-a476-5d8dc19c3e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-535943891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d18bfa-c258-4378-ad40-5278f615d875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35805d48a6b46e0a18ad99be2247291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:59:27Z,use_quota=True,user_id='a47faf0bffe742a6b4d2135342b1a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f609fa2-bf5e-4f39-b741-92921d4bb426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f609fa2-bf5e-4f39-b741-92921d4bb426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da39253-3d2c-4583-a70e-09f847aeff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da39253-3d2c-4583-a70e-09f847aeff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d18bfa-c258-4378-ad40-5278f615d875', 'volume_name': 'volume-54d18bfa-c258-4378-ad40-5278f615d875', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f8223-8b00-430e-a354-12aa44810c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f8223-8b00-430e-a354-12aa44810c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00cc4e9-bfb9-40ed-8589-24e648c8e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:27 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Volume 54d18bfa-c258-4378-ad40-5278f615d875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d18bfa-c258-4378-ad40-5278f615d875', 'volume_size': 1}
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:59:27 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root
Jun 01 01:59:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc 1073741824" returned: 0 in 0.862s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:59:28 devstack sudo[103018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc
Jun 01 01:59:28 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:59:28 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc" returned: 0 in 0.619s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.141s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-05-31T23:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-535943891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d18bfa-c258-4378-ad40-5278f615d875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35805d48a6b46e0a18ad99be2247291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-05-31T23:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-05-31T23:59:27Z,use_quota=True,user_id='a47faf0bffe742a6b4d2135342b1a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Creating volume 54d18bfa-c258-4378-ad40-5278f615d875 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 01:59:28 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:59:28 devstack sudo[103021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875 1073741824
Jun 01 01:59:28 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cca1de4-161a-49c5-89d3-4e40a66429c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35814b55-63c3-490d-8926-508664cba885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Volume volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc (b6e136c3-e538-4c47-8fa3-99d8eb8738bc): created successfully
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35814b55-63c3-490d-8926-508664cba885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Flow 'volume_create_manager' (e0f04afc-64cc-462e-a83b-f9a61146e44f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:59:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7746f651-d358-4e1c-bf66-a1f3a3d19bda tempest-TestServerVolumeAttachmentScenario-1884777046 None] Created volume successfully.
Jun 01 01:59:29 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root
Jun 01 01:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875 1073741824" returned: 0 in 0.826s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:59:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:59:29 devstack sudo[103026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875
Jun 01 01:59:29 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:59:30 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root
Jun 01 01:59:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 01:59:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00cc4e9-bfb9-40ed-8589-24e648c8e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d18bfa-c258-4378-ad40-5278f615d875', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c6f913-37f4-444e-87a7-43ddbc6d830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 01:59:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Volume volume-54d18bfa-c258-4378-ad40-5278f615d875 (54d18bfa-c258-4378-ad40-5278f615d875): created successfully
Jun 01 01:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c6f913-37f4-444e-87a7-43ddbc6d830a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 01:59:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Flow 'volume_create_manager' (73ba9bb1-33af-459f-8091-ea43031a24c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 01:59:30 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-573ee6da-097c-45e0-8fd3-e70de145f461 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Created volume successfully.
Jun 01 01:59:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:59:40 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 01:59:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 01:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 01:59:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 01:59:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 01:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 01:59:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 01:59:52 devstack sudo[103125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 01:59:52 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 01:59:53 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root
Jun 01 01:59:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.605s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 01:59:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 01:59:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 01:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 01:59:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 02:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-56dcd095-a029-4117-a3d5-de0fa03512db req-5bf8b6d0-c3cb-490e-8351-d7025b15e1c0 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-56dcd095-a029-4117-a3d5-de0fa03512db req-5bf8b6d0-c3cb-490e-8351-d7025b15e1c0 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:00:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ca5ab7-6fa4-44c8-bc75-0890a57ef3ec]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:00:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-56dcd095-a029-4117-a3d5-de0fa03512db req-5bf8b6d0-c3cb-490e-8351-d7025b15e1c0 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:08 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc
Jun 01 02:00:08 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:09 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-56dcd095-a029-4117-a3d5-de0fa03512db req-5bf8b6d0-c3cb-490e-8351-d7025b15e1c0 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-56dcd095-a029-4117-a3d5-de0fa03512db req-5bf8b6d0-c3cb-490e-8351-d7025b15e1c0 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.718s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:00:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-56dcd095-a029-4117-a3d5-de0fa03512db req-5bf8b6d0-c3cb-490e-8351-d7025b15e1c0 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfa68411-bb52-4724-802e-22d61e9008ce', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 02:00:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-56dcd095-a029-4117-a3d5-de0fa03512db req-5bf8b6d0-c3cb-490e-8351-d7025b15e1c0 tempest-TestServerVolumeAttachmentScenario-1884777046 None] attachment_update completed successfully.
Jun 01 02:00:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ae5c2f9a-d9ee-4da4-856e-4736d81da651 req-9251bd67-7fe6-4261-8474-55ff6242067c tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:00:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ae5c2f9a-d9ee-4da4-856e-4736d81da651 req-9251bd67-7fe6-4261-8474-55ff6242067c tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:00:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2326f48-d15c-47de-bc07-abbf19406050]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:00:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-ae5c2f9a-d9ee-4da4-856e-4736d81da651 req-9251bd67-7fe6-4261-8474-55ff6242067c tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:18 devstack sudo[103595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875
Jun 01 02:00:18 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:19 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-ae5c2f9a-d9ee-4da4-856e-4736d81da651 req-9251bd67-7fe6-4261-8474-55ff6242067c tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-ae5c2f9a-d9ee-4da4-856e-4736d81da651 req-9251bd67-7fe6-4261-8474-55ff6242067c tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.715s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:00:19 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-ae5c2f9a-d9ee-4da4-856e-4736d81da651 req-9251bd67-7fe6-4261-8474-55ff6242067c tempest-TestServerVolumeAttachmentScenario-1884777046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-54d18bfa-c258-4378-ad40-5278f615d875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef59c795-5ddf-47c4-8f69-0385e7b2985a', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 02:00:19 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-ae5c2f9a-d9ee-4da4-856e-4736d81da651 req-9251bd67-7fe6-4261-8474-55ff6242067c tempest-TestServerVolumeAttachmentScenario-1884777046 None] attachment_update completed successfully.
Jun 01 02:00:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-ab7bd4da-0734-4db8-bf8d-d548f1a932aa req-d68f76a7-3e1b-4f77-b0a0-fbdc0cfb23de tempest-TestServerVolumeAttachmentScenario-1884777046 None] Terminate volume connection completed successfully.
Jun 01 02:00:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-ab7bd4da-0734-4db8-bf8d-d548f1a932aa req-d68f76a7-3e1b-4f77-b0a0-fbdc0cfb23de tempest-TestServerVolumeAttachmentScenario-1884777046 None] Deleting attachment ef59c795-5ddf-47c4-8f69-0385e7b2985a. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 02:00:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-5d917066-18db-4da9-a952-ce71b266991f req-32d19980-8bde-4a70-8225-04e13b51a92a tempest-TestServerVolumeAttachmentScenario-1884777046 None] Terminate volume connection completed successfully.
Jun 01 02:00:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-5d917066-18db-4da9-a952-ce71b266991f req-32d19980-8bde-4a70-8225-04e13b51a92a tempest-TestServerVolumeAttachmentScenario-1884777046 None] Deleting attachment dfa68411-bb52-4724-802e-22d61e9008ce. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 02:00:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:00:38 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:00:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "cinder-54d18bfa-c258-4378-ad40-5278f615d875-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:00:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-54d18bfa-c258-4378-ad40-5278f615d875-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:00:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "cinder-quobyte-54d18bfa-c258-4378-ad40-5278f615d875" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:00:39 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-quobyte-54d18bfa-c258-4378-ad40-5278f615d875" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:00:39 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8468492-a1bd-4661-a926-8a22222ca018]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:00:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:39 devstack sudo[103676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875
Jun 01 02:00:39 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:40 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:40 devstack sudo[103682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875
Jun 01 02:00:40 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:41 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-54d18bfa-c258-4378-ad40-5278f615d875" returned: 0 in 0.588s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-quobyte-54d18bfa-c258-4378-ad40-5278f615d875" released by "delete_volume" :: held 1.337s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Created reservations ['7c6ad776-71c9-4ebb-ac4e-79e9ab6bfb41', 'e640785f-3374-48a5-92cf-9979e4c366e2', '68578c31-a6eb-4697-ace8-c1d6dfbf5a5b', 'fe13b988-2f8f-4769-a195-c97b6f8356ac'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:41 devstack sudo[103686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:00:41 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:41 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.580s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:00:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Deleted volume successfully.
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5ab5f943-a25f-4933-a0c6-ea1e2e2b2023 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-54d18bfa-c258-4378-ad40-5278f615d875-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:00:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "cinder-b6e136c3-e538-4c47-8fa3-99d8eb8738bc-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:00:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-b6e136c3-e538-4c47-8fa3-99d8eb8738bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:00:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "cinder-quobyte-b6e136c3-e538-4c47-8fa3-99d8eb8738bc" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:00:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-quobyte-b6e136c3-e538-4c47-8fa3-99d8eb8738bc" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:00:42 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dca603-3154-4126-8c55-97a37570e478]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:00:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:42 devstack sudo[103689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc
Jun 01 02:00:42 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:42 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc" returned: 0 in 0.691s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:42 devstack sudo[103695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc
Jun 01 02:00:42 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:43 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b6e136c3-e538-4c47-8fa3-99d8eb8738bc" returned: 0 in 0.573s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-quobyte-b6e136c3-e538-4c47-8fa3-99d8eb8738bc" released by "delete_volume" :: held 1.306s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Created reservations ['c12b2c1d-3f19-4cbf-8466-a0a49c99eec9', '7c3f2c94-e493-49d0-9140-9929465ce944', '0b581197-adcd-4597-94ce-dc6173224548', '44ad87de-0b53-4795-bfcc-10e7c3baef94'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:00:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:43 devstack sudo[103698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:00:43 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:44 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.581s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:44 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:00:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Deleted volume successfully.
Jun 01 02:00:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2a51f186-7819-49cf-9ccf-f4f2356b0aa1 tempest-TestServerVolumeAttachmentScenario-1884777046 None] Lock "cinder-b6e136c3-e538-4c47-8fa3-99d8eb8738bc-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:00:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:00:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:00:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:00:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:00:52 devstack sudo[103706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:00:52 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:00:53 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root
Jun 01 02:00:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.622s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:00:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:00:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:00:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 02:00:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 02:00:53 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=17,cinder:SELECT=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:00:54 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Flow 'volume_create_manager' (4b7a24c0-8a7a-4e77-b15e-61757c575990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44b06f9-a810-4540-a79e-f9bd28c4251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44b06f9-a810-4540-a79e-f9bd28c4251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-797715499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec9343-7a9e-4a24-bba7-0759f5187684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e439dae9ea94068b452a4012d6a6a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:01:14Z,use_quota=True,user_id='e4b16c89ea1e4b6192c51e74b778302a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd328d3-4e6f-453f-9ee5-fe5b13e4c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd328d3-4e6f-453f-9ee5-fe5b13e4c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1ac31e-8583-4246-be17-c46384b199c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:01:13 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1ac31e-8583-4246-be17-c46384b199c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fec9343-7a9e-4a24-bba7-0759f5187684', 'volume_name': 'volume-8fec9343-7a9e-4a24-bba7-0759f5187684', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7286556283e0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588a6afc-885f-4ad3-8d61-f5a1d4556913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588a6afc-885f-4ad3-8d61-f5a1d4556913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fd7dfe-9936-40e7-99ab-5c9578b7aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:01:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Volume 8fec9343-7a9e-4a24-bba7-0759f5187684: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fec9343-7a9e-4a24-bba7-0759f5187684', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7286556283e0>}
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Trying to clone 8fec9343-7a9e-4a24-bba7-0759f5187684 from image e56da659-fc04-4789-a705-f5b7a7a6ddfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 02:01:14 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Image download 20.69 MB at 20.69 MB/s
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3950521-4acf-438b-bafe-5c9b2092545c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:01:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:14 devstack sudo[103757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD
Jun 01 02:01:14 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:15 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:15 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd is fetched for user e4b16c89ea1e4b6192c51e74b778302a. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 02:01:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf5cf51-ce48-4f30-ba65-ee986f6f3756]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:01:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:15 devstack sudo[103762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD
Jun 01 02:01:15 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:16 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-797715499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fec9343-7a9e-4a24-bba7-0759f5187684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e439dae9ea94068b452a4012d6a6a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:01:14Z,use_quota=True,user_id='e4b16c89ea1e4b6192c51e74b778302a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Creating volume 8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:01:16 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:16 devstack sudo[103767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 1073741824
Jun 01 02:01:16 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:16 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 1073741824" returned: 0 in 0.739s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:16 devstack sudo[103773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:01:16 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:17 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 0 in 0.594s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:01:17 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Attempting download of e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume 8fec9343-7a9e-4a24-bba7-0759f5187684. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 02:01:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c97a038-9390-4a6e-8c14-c88bf6d48d2f]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:01:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ve9cskau {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:17 devstack sudo[103776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ve9cskau
Jun 01 02:01:17 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:18 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ve9cskau" returned: 0 in 0.653s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ve9cskau {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:18 devstack sudo[103780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ve9cskau
Jun 01 02:01:18 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:18 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ve9cskau" returned: 1 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ve9cskau' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:01:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e1f0ba-7b16-470f-89b1-126b3e11daf6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:01:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:18 devstack sudo[103784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD
Jun 01 02:01:18 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:19 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:19 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] e56da659-fc04-4789-a705-f5b7a7a6ddfd was qcow2, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 02:01:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:19 devstack sudo[103789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:01:19 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:21 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 0 in 1.684s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:21 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e56da659-fc04-4789-a705-f5b7a7a6ddfd_ujygfn_pdevstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 02:01:21 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Converted 112.00 MB image at 66.39 MB/s
Jun 01 02:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:21 devstack sudo[103797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 1G
Jun 01 02:01:21 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:21 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 1G" returned: 0 in 0.619s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6c768-84b2-4198-a464-0f39ff86d6a7]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:01:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:21 devstack sudo[103802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:01:21 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:22 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 0 in 0.678s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:22 devstack sudo[103806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:01:22 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:23 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 1 in 0.685s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Downloaded image e56da659-fc04-4789-a705-f5b7a7a6ddfd ((None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}])) to volume 8fec9343-7a9e-4a24-bba7-0759f5187684 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Temporary image e56da659-fc04-4789-a705-f5b7a7a6ddfd for user e4b16c89ea1e4b6192c51e74b778302a is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Marking volume 8fec9343-7a9e-4a24-bba7-0759f5187684 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Copying metadata from image e56da659-fc04-4789-a705-f5b7a7a6ddfd to 8fec9343-7a9e-4a24-bba7-0759f5187684. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Creating volume glance metadata for volume 8fec9343-7a9e-4a24-bba7-0759f5187684 backed by image e56da659-fc04-4789-a705-f5b7a7a6ddfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fd7dfe-9936-40e7-99ab-5c9578b7aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fec9343-7a9e-4a24-bba7-0759f5187684', 'volume_size': 1, 'image_id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee21384d876b49bcb972f5262c322ccd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e56da659-fc04-4789-a705-f5b7a7a6ddfd', 'created_at': datetime.datetime(2026, 5, 31, 23, 35, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 5, 31, 23, 35, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e56da659-fc04-4789-a705-f5b7a7a6ddfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7286556283e0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac5f17e-9d09-4e8c-a615-72897ab5e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:01:23 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Volume volume-8fec9343-7a9e-4a24-bba7-0759f5187684 (8fec9343-7a9e-4a24-bba7-0759f5187684): created successfully
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac5f17e-9d09-4e8c-a615-72897ab5e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:01:23 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Flow 'volume_create_manager' (4b7a24c0-8a7a-4e77-b15e-61757c575990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:01:23 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5fe88c5a-453d-453a-b668-20d4814788d3 tempest-TestShelveInstance-1671582502 None] Created volume successfully.
Jun 01 02:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:01:31 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03bb784-6640-44a5-8e55-e70fa5d4c208]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:01:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:31 devstack sudo[103823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:01:31 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:32 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:32 devstack sudo[103827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:01:32 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:32 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 1 in 0.701s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:01:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.439s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:01:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-8fec9343-7a9e-4a24-bba7-0759f5187684', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea481712-04bd-4e81-a87f-8606a7aec59a', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 02:01:32 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-7c1dcc64-bfb0-41bd-bd64-08f9caa8f41a req-bda625f6-fc15-44cf-8632-40bcc91af4be tempest-TestShelveInstance-1671582502 None] attachment_update completed successfully.
Jun 01 02:01:42 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=7,cinder:SELECT=13,cinder:INSERT=9 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:01:42 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:01:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:01:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:01:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:01:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:01:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:01:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:01:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:01:52 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:01:52 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:01:53 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Jun 01 02:01:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.656s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:01:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:01:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:01:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 02:01:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 02:02:09 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-f2e8feac-87b4-4f2f-ae69-057f71fbe609 req-c7b096ac-8fc8-4571-a10a-e4849a8b76a1 tempest-TestShelveInstance-1671582502 None] Terminate volume connection completed successfully.
Jun 01 02:02:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-f2e8feac-87b4-4f2f-ae69-057f71fbe609 req-c7b096ac-8fc8-4571-a10a-e4849a8b76a1 tempest-TestShelveInstance-1671582502 None] Deleting attachment ea481712-04bd-4e81-a87f-8606a7aec59a. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 02:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:02:13 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffe5c90-6370-43af-8493-95ae318cd1ed]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:02:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:02:14 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:02:14 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:02:14 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Jun 01 02:02:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 0 in 0.701s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:02:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:02:14 devstack sudo[104495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:02:14 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:02:15 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root
Jun 01 02:02:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 1 in 0.689s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:02:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:02:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.433s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:02:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4', 'name': 'volume-8fec9343-7a9e-4a24-bba7-0759f5187684', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32ae8ddd-74fe-46e5-bf5c-363bc69fd7d7', 'enforce_multipath': True} {{(pid=86676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 01 02:02:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-26b18ed4-4a02-4a70-a570-da28e12a17e4 req-444cf22f-0071-4c7f-86ac-bd0f3217c36c tempest-TestShelveInstance-1671582502 None] attachment_update completed successfully.
Jun 01 02:02:31 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:02:31 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:02:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:02:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:02:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:02:52 devstack sudo[104989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:02:52 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:02:53 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root
Jun 01 02:02:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.701s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:02:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:02:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 02:02:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 02:02:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-c7d57403-0fd3-4a62-848d-b454a57b752b tempest-TestShelveInstance-1671582502 None] Terminate volume connection completed successfully.
Jun 01 02:02:55 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-c7d57403-0fd3-4a62-848d-b454a57b752b tempest-TestShelveInstance-1671582502 None] Deleting attachment 32ae8ddd-74fe-46e5-bf5c-363bc69fd7d7. {{(pid=86676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Acquiring lock "cinder-8fec9343-7a9e-4a24-bba7-0759f5187684-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Lock "cinder-8fec9343-7a9e-4a24-bba7-0759f5187684-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Acquiring lock "cinder-quobyte-8fec9343-7a9e-4a24-bba7-0759f5187684" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Lock "cinder-quobyte-8fec9343-7a9e-4a24-bba7-0759f5187684" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5935bcf1-a350-4a38-af06-0df485b07b16]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:02:56 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:02:56 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:02:56 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 0 in 0.692s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:02:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:02:56 devstack sudo[105083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:02:57 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:02:57 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root
Jun 01 02:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 1 in 0.676s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:02:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:02:57 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684
Jun 01 02:02:57 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:02:58 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8fec9343-7a9e-4a24-bba7-0759f5187684" returned: 0 in 0.582s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Lock "cinder-quobyte-8fec9343-7a9e-4a24-bba7-0759f5187684" released by "delete_volume" :: held 2.006s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG cinder.quota [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Created reservations ['84b1033d-d54a-481c-b3bf-dcf705f868da', 'a07ef4b2-9c0e-4242-9774-66bcd4558085', 'a013697d-6622-4baa-a3c6-4ae77a00bb63', 'bde1769a-485c-4c58-95d4-4a4745f8beb3'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:02:58 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:02:58 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:02:58 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.595s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG cinder.manager [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:02:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Deleted volume successfully.
Jun 01 02:02:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [req-eb6c07a6-fbf2-4a09-8279-975d60a1cfd4 req-2f992120-b11a-4b7a-bea6-6b8d3fadeac2 tempest-TestShelveInstance-1671582502 None] Lock "cinder-8fec9343-7a9e-4a24-bba7-0759f5187684-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (2d81aa10-2e13-4cae-ac64-09ec47d1c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a663256-b518-4fc5-829a-9a6259b6a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a663256-b518-4fc5-829a-9a6259b6a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717274796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:09Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6a3573-702c-48cb-a928-7ab9dad1c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6a3573-702c-48cb-a928-7ab9dad1c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee5f35b-a2e2-4541-aac6-a7d3d3a8083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee5f35b-a2e2-4541-aac6-a7d3d3a8083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e', 'volume_name': 'volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04d93ae-b411-4cdb-aa29-289cee62177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04d93ae-b411-4cdb-aa29-289cee62177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8bb7d1-6a36-4125-889a-8a4614bb8b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Volume db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e', 'volume_size': 1}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717274796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:09Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Creating volume db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:08 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:08 devstack sudo[105099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e 1073741824
Jun 01 02:03:08 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (4e36ad06-f176-4f62-a4af-5afca46dd377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29eeb70-6ef1-4f39-b64e-1d1719d1f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29eeb70-6ef1-4f39-b64e-1d1719d1f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750326863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ad9834-d302-4155-b124-f9ae01c2008e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:09Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e19948-be35-4d26-8bbc-98c67438dad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e19948-be35-4d26-8bbc-98c67438dad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b228b3ec-1311-43c2-96ce-e0f3f3ae287b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b228b3ec-1311-43c2-96ce-e0f3f3ae287b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ad9834-d302-4155-b124-f9ae01c2008e', 'volume_name': 'volume-92ad9834-d302-4155-b124-f9ae01c2008e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226bdf9f-64f1-4451-bfd3-5d9b4e2fd716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226bdf9f-64f1-4451-bfd3-5d9b4e2fd716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09655a2e-9f1a-4128-accf-95f9c214278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Volume 92ad9834-d302-4155-b124-f9ae01c2008e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ad9834-d302-4155-b124-f9ae01c2008e', 'volume_size': 1}
Jun 01 02:03:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (561be28d-d70c-4dbb-915c-69025bb5684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf513a26-e936-4b1e-b3ce-60e2dc57313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf513a26-e936-4b1e-b3ce-60e2dc57313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101061154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d913e56-4428-4cf9-818a-09f5d80bc8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:09Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32f5454-dab4-4e23-8f29-6669979b12b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32f5454-dab4-4e23-8f29-6669979b12b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a74516-e602-416e-b65a-8c6fb2c17358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a74516-e602-416e-b65a-8c6fb2c17358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d913e56-4428-4cf9-818a-09f5d80bc8d6', 'volume_name': 'volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe3d48d-b546-4f46-93a1-8d4f492adaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe3d48d-b546-4f46-93a1-8d4f492adaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ceca27-446c-42f6-8581-145413383c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Volume 8d913e56-4428-4cf9-818a-09f5d80bc8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6', 'volume_size': 1}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:09 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (72f2592d-66f5-487c-995c-fbb7a31d0033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1e1ebb-a0e7-4bfa-94c7-5be32da3dc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e 1073741824" returned: 0 in 0.916s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1e1ebb-a0e7-4bfa-94c7-5be32da3dc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644824750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7c9065-b946-4cfa-ad68-d863985172ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:10Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70332cfa-c261-4536-82cc-f760bdb9df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70332cfa-c261-4536-82cc-f760bdb9df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0024a68a-92da-45e1-9683-aa7d898d7248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0024a68a-92da-45e1-9683-aa7d898d7248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f7c9065-b946-4cfa-ad68-d863985172ae', 'volume_name': 'volume-6f7c9065-b946-4cfa-ad68-d863985172ae', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e1525a-ceb7-4d25-84a6-55af6f1f7d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e1525a-ceb7-4d25-84a6-55af6f1f7d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5a9de6-7594-4344-8f3a-d6e38d768a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Volume 6f7c9065-b946-4cfa-ad68-d863985172ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f7c9065-b946-4cfa-ad68-d863985172ae', 'volume_size': 1}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:09 devstack sudo[105105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e
Jun 01 02:03:09 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (593f4216-6c5a-4103-ac6c-5c4d90f9934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32046197-8e74-4cc8-83cb-8c8a6f4959d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32046197-8e74-4cc8-83cb-8c8a6f4959d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574907566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cdaff1-bcdb-476f-9d97-3a174c68ddb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:10Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afedd36-387b-4b05-ba98-210a2452ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afedd36-387b-4b05-ba98-210a2452ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8607252-0578-42b6-97fd-bb29d6449d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8607252-0578-42b6-97fd-bb29d6449d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24cdaff1-bcdb-476f-9d97-3a174c68ddb0', 'volume_name': 'volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6167b4b-8d07-44ae-a0a7-ff2e3ff27826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6167b4b-8d07-44ae-a0a7-ff2e3ff27826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63714d5-e9da-46d2-94ce-4aca6c634b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Volume 24cdaff1-bcdb-476f-9d97-3a174c68ddb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0', 'volume_size': 1}
Jun 01 02:03:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:10 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e" returned: 0 in 0.644s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750326863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ad9834-d302-4155-b124-f9ae01c2008e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:09Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Creating volume 92ad9834-d302-4155-b124-f9ae01c2008e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:10 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8bb7d1-6a36-4125-889a-8a4614bb8b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1503645-5e37-45d2-85dd-17adc951b2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:10 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e 1073741824
Jun 01 02:03:10 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Volume volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e (db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e): created successfully
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1503645-5e37-45d2-85dd-17adc951b2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (2d81aa10-2e13-4cae-ac64-09ec47d1c180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1e851bd2-4fa3-4ebb-85fe-c1672fcfb3fe tempest-CreateVolumesFromImageTest-1644961489 None] Created volume successfully.
Jun 01 02:03:11 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e 1073741824" returned: 0 in 0.773s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:11 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e
Jun 01 02:03:11 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:11 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e" returned: 0 in 0.588s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.415s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101061154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d913e56-4428-4cf9-818a-09f5d80bc8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:09Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Creating volume 8d913e56-4428-4cf9-818a-09f5d80bc8d6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:11 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09655a2e-9f1a-4128-accf-95f9c214278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ad9834-d302-4155-b124-f9ae01c2008e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:11 devstack sudo[105117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6 1073741824
Jun 01 02:03:11 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fcea23-7387-4afb-a8ad-87fa38c6e749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:11 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Volume volume-92ad9834-d302-4155-b124-f9ae01c2008e (92ad9834-d302-4155-b124-f9ae01c2008e): created successfully
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fcea23-7387-4afb-a8ad-87fa38c6e749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:11 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (4e36ad06-f176-4f62-a4af-5afca46dd377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:11 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a3cc15f8-679d-4a8b-ab80-7e58ebe550c9 tempest-CreateVolumesFromImageTest-1644961489 None] Created volume successfully.
Jun 01 02:03:12 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6 1073741824" returned: 0 in 0.760s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:12 devstack sudo[105122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6
Jun 01 02:03:12 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:13 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6" returned: 0 in 0.593s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.495s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644824750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7c9065-b946-4cfa-ad68-d863985172ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:10Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Creating volume 6f7c9065-b946-4cfa-ad68-d863985172ae {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:13 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ceca27-446c-42f6-8581-145413383c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229bd99-5b62-40fc-8beb-e428adc3b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:13 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae 1073741824
Jun 01 02:03:13 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:13 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Volume volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6 (8d913e56-4428-4cf9-818a-09f5d80bc8d6): created successfully
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229bd99-5b62-40fc-8beb-e428adc3b106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (561be28d-d70c-4dbb-915c-69025bb5684c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7b5fb012-ec5d-43d9-a605-8a1a805d2625 tempest-CreateVolumesFromImageTest-1644961489 None] Created volume successfully.
Jun 01 02:03:13 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae 1073741824" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:13 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae
Jun 01 02:03:13 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:14 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae" returned: 0 in 0.597s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.555s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574907566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cdaff1-bcdb-476f-9d97-3a174c68ddb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d68e0242304fc1886501209d324d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:10Z,use_quota=True,user_id='f8a478d2f2454cb1b05b119b9286f38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Creating volume 24cdaff1-bcdb-476f-9d97-3a174c68ddb0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:14 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:14 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0 1073741824
Jun 01 02:03:14 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5a9de6-7594-4344-8f3a-d6e38d768a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7c9065-b946-4cfa-ad68-d863985172ae', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe9148c-836e-42ba-8083-440f316cef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Volume volume-6f7c9065-b946-4cfa-ad68-d863985172ae (6f7c9065-b946-4cfa-ad68-d863985172ae): created successfully
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe9148c-836e-42ba-8083-440f316cef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (72f2592d-66f5-487c-995c-fbb7a31d0033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fc89f839-e108-4ec9-9942-b158c263341f tempest-CreateVolumesFromImageTest-1644961489 None] Created volume successfully.
Jun 01 02:03:15 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0 1073741824" returned: 0 in 0.747s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:15 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0
Jun 01 02:03:15 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:15 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0" returned: 0 in 0.581s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63714d5-e9da-46d2-94ce-4aca6c634b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd5f951-eb2c-49c8-9eb3-fffcbf8c3fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Volume volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0 (24cdaff1-bcdb-476f-9d97-3a174c68ddb0): created successfully
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd5f951-eb2c-49c8-9eb3-fffcbf8c3fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Flow 'volume_create_manager' (593f4216-6c5a-4103-ac6c-5c4d90f9934a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-31791612-7a07-486b-942c-f8a4ff4f0cc2 tempest-CreateVolumesFromImageTest-1644961489 None] Created volume successfully.
Jun 01 02:03:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-24cdaff1-bcdb-476f-9d97-3a174c68ddb0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-24cdaff1-bcdb-476f-9d97-3a174c68ddb0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-quobyte-24cdaff1-bcdb-476f-9d97-3a174c68ddb0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:16 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-24cdaff1-bcdb-476f-9d97-3a174c68ddb0" acquired by "delete_volume" :: waited 0.013s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:16 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[95628ade-b7ac-45d6-b7bb-72476a4256e4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:16 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0
Jun 01 02:03:16 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:17 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0" returned: 0 in 0.714s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:17 devstack sudo[105147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0
Jun 01 02:03:17 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:17 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24cdaff1-bcdb-476f-9d97-3a174c68ddb0" returned: 0 in 0.580s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-24cdaff1-bcdb-476f-9d97-3a174c68ddb0" released by "delete_volume" :: held 1.331s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Created reservations ['5ba64b20-ef2a-4277-803e-b79c1b95674a', '198a8186-a2ab-4003-b875-70c4fb904f4b', '06198222-5661-48e1-8877-69008584ff36', '237ca918-9241-42c0-ab52-028edb675314'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:18 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:18 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:18 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.576s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Deleted volume successfully.
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-6bb9edd1-01cf-495b-a155-d4128add1b15 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-24cdaff1-bcdb-476f-9d97-3a174c68ddb0-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-6f7c9065-b946-4cfa-ad68-d863985172ae-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-6f7c9065-b946-4cfa-ad68-d863985172ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-quobyte-6f7c9065-b946-4cfa-ad68-d863985172ae" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-6f7c9065-b946-4cfa-ad68-d863985172ae" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c978b17-f8f6-4455-8fcf-743572774ed5]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:18 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae
Jun 01 02:03:18 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:19 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:19 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae
Jun 01 02:03:19 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:20 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6f7c9065-b946-4cfa-ad68-d863985172ae" returned: 0 in 0.588s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-6f7c9065-b946-4cfa-ad68-d863985172ae" released by "delete_volume" :: held 1.330s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Created reservations ['21f45d52-5919-4d33-84e8-401e8badcebc', '5a4e9e5e-16f8-4df6-bc35-f13b9321393b', 'c0d3fad5-e5a1-4bbe-8a54-1847199154d0', '466a3012-5c05-40ac-ad9d-d5ed61e83951'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:20 devstack sudo[105161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:20 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:20 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.592s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Deleted volume successfully.
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e2bd5d54-52d0-4fc6-81f0-9df666b4c424 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-6f7c9065-b946-4cfa-ad68-d863985172ae-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-8d913e56-4428-4cf9-818a-09f5d80bc8d6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-8d913e56-4428-4cf9-818a-09f5d80bc8d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-quobyte-8d913e56-4428-4cf9-818a-09f5d80bc8d6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-8d913e56-4428-4cf9-818a-09f5d80bc8d6" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:21 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[10acffff-95af-4144-8cae-1bc4c2827284]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:21 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6
Jun 01 02:03:21 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:21 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6" returned: 0 in 0.683s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:21 devstack sudo[105170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6
Jun 01 02:03:21 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:22 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-8d913e56-4428-4cf9-818a-09f5d80bc8d6" returned: 0 in 0.592s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-8d913e56-4428-4cf9-818a-09f5d80bc8d6" released by "delete_volume" :: held 1.313s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Created reservations ['6f1ee432-b5c7-4ebb-ba8e-c97f75d05d0d', '581e0475-8470-471e-8ffd-efc45382c003', '406d66a8-2b18-44b6-8cc4-1d5f553a0b21', 'f189517b-a639-4864-8258-35eee43400d5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:22 devstack sudo[105173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:22 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:22 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.580s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Deleted volume successfully.
Jun 01 02:03:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-062f0ccc-4952-4f7f-a266-ece0d0602c74 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-8d913e56-4428-4cf9-818a-09f5d80bc8d6-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-92ad9834-d302-4155-b124-f9ae01c2008e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-92ad9834-d302-4155-b124-f9ae01c2008e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-quobyte-92ad9834-d302-4155-b124-f9ae01c2008e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-92ad9834-d302-4155-b124-f9ae01c2008e" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbdaa7c-a7ef-46f7-b892-a919caf96875]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:23 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e
Jun 01 02:03:23 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:23 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e" returned: 0 in 0.692s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:23 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e
Jun 01 02:03:23 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:24 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-92ad9834-d302-4155-b124-f9ae01c2008e" returned: 0 in 0.609s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-92ad9834-d302-4155-b124-f9ae01c2008e" released by "delete_volume" :: held 1.341s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Created reservations ['93e653cd-242d-4554-9d19-464d2c1515de', '35f8a656-ed99-4ffb-ab0e-7bf44efaf757', 'f22ebbc1-82dc-4515-abc3-e68814994a6a', 'f68e3eea-47b5-4ace-adb6-27699273b346'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:24 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:24 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:25 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.583s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:25 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Deleted volume successfully.
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-07b76365-7acd-4292-a9c1-bfb8423dd2e9 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-92ad9834-d302-4155-b124-f9ae01c2008e-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "cinder-quobyte-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1d906-f544-4fa2-909f-1d3e3a2a3bed]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:25 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e
Jun 01 02:03:25 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:26 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:26 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e
Jun 01 02:03:26 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:26 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e" returned: 0 in 0.582s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-quobyte-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e" released by "delete_volume" :: held 1.316s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Created reservations ['a6374890-1522-4e74-9c88-0d805e72c155', '1667cd95-0a3f-4026-a1b8-ddfaecdf4913', '2e220e9b-8123-4654-aa50-73eca9671bd1', '427a7369-20af-4f18-96b9-d7066c516f27'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:26 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:26 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:27 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.598s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:27 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:27 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Deleted volume successfully.
Jun 01 02:03:27 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-df1ba991-0f9a-4d0f-b79b-0b8f564d8893 tempest-CreateVolumesFromImageTest-1644961489 None] Lock "cinder-db5eba3d-41e5-4303-91d9-5e0c4b1bfe9e-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (ceb6e5d3-af72-41c8-8c0d-1ab5e2ba377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d48bb5-d103-4229-97d0-fc4ced480b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d48bb5-d103-4229-97d0-fc4ced480b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945487606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ea87d4-3ec0-49e6-af5b-64c760e6ac3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:30Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262e96c5-fa67-4d0e-9aa5-664a3a7c9011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262e96c5-fa67-4d0e-9aa5-664a3a7c9011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20081a2a-a5d1-448e-974a-93e607f97919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20081a2a-a5d1-448e-974a-93e607f97919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24ea87d4-3ec0-49e6-af5b-64c760e6ac3d', 'volume_name': 'volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e678dd0d-5c7e-4ccd-aab6-3d694e81d055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e678dd0d-5c7e-4ccd-aab6-3d694e81d055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b093278b-cf62-45db-b81f-4cabfb177e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:30 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume 24ea87d4-3ec0-49e6-af5b-64c760e6ac3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d', 'volume_size': 1}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945487606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ea87d4-3ec0-49e6-af5b-64c760e6ac3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:30Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Creating volume 24ea87d4-3ec0-49e6-af5b-64c760e6ac3d {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:30 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:30 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d 1073741824
Jun 01 02:03:30 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:30 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d 1073741824" returned: 0 in 0.789s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:30 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d
Jun 01 02:03:30 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:31 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d" returned: 0 in 0.584s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b093278b-cf62-45db-b81f-4cabfb177e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71bb27f-5693-438f-95b0-064c3ed1e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:31 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d (24ea87d4-3ec0-49e6-af5b-64c760e6ac3d): created successfully
Jun 01 02:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71bb27f-5693-438f-95b0-064c3ed1e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (ceb6e5d3-af72-41c8-8c0d-1ab5e2ba377e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4476cc8d-c2a6-4407-bc56-fa414cc3298d tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created volume successfully.
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (b76b79b7-3723-4184-a503-726a287c001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bf1726-58bd-49ee-9635-0e447f2a5f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bf1726-58bd-49ee-9635-0e447f2a5f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404436045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e394e14-7bbc-47e6-b53b-f7e66a7030b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:33Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4357253-d740-4d53-aca8-681244272add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4357253-d740-4d53-aca8-681244272add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6551680a-10e3-43c4-8052-183367a72a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6551680a-10e3-43c4-8052-183367a72a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e394e14-7bbc-47e6-b53b-f7e66a7030b0', 'volume_name': 'volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4ba9ee-1ac0-4984-9afa-2c23bb93341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4ba9ee-1ac0-4984-9afa-2c23bb93341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcf02d8-8fa1-4910-841b-0cedd9fc6978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume 6e394e14-7bbc-47e6-b53b-f7e66a7030b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0', 'volume_size': 1}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404436045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e394e14-7bbc-47e6-b53b-f7e66a7030b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:33Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Creating volume 6e394e14-7bbc-47e6-b53b-f7e66a7030b0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:32 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0 1073741824
Jun 01 02:03:32 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (b68757e1-a8cd-4fe4-ba86-4654ea9f917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ee59e9-2322-4b89-921f-10ec11a5d63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ee59e9-2322-4b89-921f-10ec11a5d63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237056855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f56caae-227e-4b14-a257-c805ca5c905d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:33Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d79b5a-74cf-4692-9ac4-07720902e0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d79b5a-74cf-4692-9ac4-07720902e0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b3d94d-b686-4aba-a059-4b6ccfc545c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b3d94d-b686-4aba-a059-4b6ccfc545c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f56caae-227e-4b14-a257-c805ca5c905d', 'volume_name': 'volume-2f56caae-227e-4b14-a257-c805ca5c905d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f9c2eb-27e6-414c-9147-f430072301e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f9c2eb-27e6-414c-9147-f430072301e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7471b704-d6dd-4425-a8c3-0498f6120d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume 2f56caae-227e-4b14-a257-c805ca5c905d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f56caae-227e-4b14-a257-c805ca5c905d', 'volume_size': 1}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (8f8a3fb9-8f31-412e-9a91-e2c7eff9edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c1b788-a4f5-4b5f-ae2a-316630eb8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c1b788-a4f5-4b5f-ae2a-316630eb8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1271131366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ba989a-94c9-4529-a6c4-b1b4ca67e35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:33Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004275c-87e7-45e8-9168-e481f2fee989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004275c-87e7-45e8-9168-e481f2fee989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523a9b26-a6b2-4517-8a54-7fe6b7628ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523a9b26-a6b2-4517-8a54-7fe6b7628ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ba989a-94c9-4529-a6c4-b1b4ca67e35f', 'volume_name': 'volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158706b8-75a7-47a0-a89f-84281ceed78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158706b8-75a7-47a0-a89f-84281ceed78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872f6d02-3c00-435f-9505-ed1b13a9284f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume a9ba989a-94c9-4529-a6c4-b1b4ca67e35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f', 'volume_size': 1}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:33 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0 1073741824" returned: 0 in 0.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (ddaa1c63-b668-4195-92de-4b4a1b41d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d171a945-0a6e-48ab-9584-e9d48ae20f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d171a945-0a6e-48ab-9584-e9d48ae20f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-372772773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602aff42-9188-4a62-b4dc-0278f38f594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:34Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0
Jun 01 02:03:33 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdccf77-678f-4351-b326-b9f310bb1647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdccf77-678f-4351-b326-b9f310bb1647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bbb0d7-cffb-479c-8103-248d891b4104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bbb0d7-cffb-479c-8103-248d891b4104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602aff42-9188-4a62-b4dc-0278f38f594b', 'volume_name': 'volume-602aff42-9188-4a62-b4dc-0278f38f594b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1656e22-9a56-4330-9947-fae934f1d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1656e22-9a56-4330-9947-fae934f1d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601138ca-e7a3-4635-93c2-d6cfbac7d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume 602aff42-9188-4a62-b4dc-0278f38f594b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602aff42-9188-4a62-b4dc-0278f38f594b', 'volume_size': 1}
Jun 01 02:03:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (95dcfb97-7c81-43fa-a533-abe30bacde58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe66e8-0967-4681-9069-8b6b5f17606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe66e8-0967-4681-9069-8b6b5f17606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115136879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f595f6f-fc60-4dfe-b392-0be4656436fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:34Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6915e0-1b22-4a2d-85f5-fba935096e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6915e0-1b22-4a2d-85f5-fba935096e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa15cb2-9b3c-4c18-9e9a-9befcc612e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa15cb2-9b3c-4c18-9e9a-9befcc612e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f595f6f-fc60-4dfe-b392-0be4656436fe', 'volume_name': 'volume-4f595f6f-fc60-4dfe-b392-0be4656436fe', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4b30be-2b45-4570-8aef-94fc4db4c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4b30be-2b45-4570-8aef-94fc4db4c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb2b04f-9063-445a-ac15-735820981734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume 4f595f6f-fc60-4dfe-b392-0be4656436fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f595f6f-fc60-4dfe-b392-0be4656436fe', 'volume_size': 1}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:34 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0" returned: 0 in 0.615s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237056855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f56caae-227e-4b14-a257-c805ca5c905d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:33Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Creating volume 2f56caae-227e-4b14-a257-c805ca5c905d {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcf02d8-8fa1-4910-841b-0cedd9fc6978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3114df9f-82a5-480c-850e-6db01c1d7249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:34 devstack sudo[105217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d 1073741824
Jun 01 02:03:34 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0 (6e394e14-7bbc-47e6-b53b-f7e66a7030b0): created successfully
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3114df9f-82a5-480c-850e-6db01c1d7249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (b76b79b7-3723-4184-a503-726a287c001b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0ee7f8f1-6a9b-4d80-bcae-fbe580d5c1a3 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created volume successfully.
Jun 01 02:03:35 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d 1073741824" returned: 0 in 0.735s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:35 devstack sudo[105223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d
Jun 01 02:03:35 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:35 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d" returned: 0 in 0.586s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.383s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1271131366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ba989a-94c9-4529-a6c4-b1b4ca67e35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:33Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Creating volume a9ba989a-94c9-4529-a6c4-b1b4ca67e35f {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:35 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:35 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f 1073741824
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7471b704-d6dd-4425-a8c3-0498f6120d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f56caae-227e-4b14-a257-c805ca5c905d', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:35 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3a8a45-34bd-4423-a614-349fc8df397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume volume-2f56caae-227e-4b14-a257-c805ca5c905d (2f56caae-227e-4b14-a257-c805ca5c905d): created successfully
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3a8a45-34bd-4423-a614-349fc8df397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (b68757e1-a8cd-4fe4-ba86-4654ea9f917a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3066eae9-a7ae-4040-8867-85ae010f53ca tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created volume successfully.
Jun 01 02:03:36 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f 1073741824" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:36 devstack sudo[105231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f
Jun 01 02:03:36 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:37 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f" returned: 0 in 0.591s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.346s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-372772773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602aff42-9188-4a62-b4dc-0278f38f594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:34Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Creating volume 602aff42-9188-4a62-b4dc-0278f38f594b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:37 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872f6d02-3c00-435f-9505-ed1b13a9284f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6fea26-017f-451e-8326-18205a7df531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:37 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b 1073741824
Jun 01 02:03:37 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f (a9ba989a-94c9-4529-a6c4-b1b4ca67e35f): created successfully
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6fea26-017f-451e-8326-18205a7df531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (8f8a3fb9-8f31-412e-9a91-e2c7eff9edd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fe484a52-5755-4133-b084-4ab3e1a2b462 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created volume successfully.
Jun 01 02:03:38 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b 1073741824" returned: 0 in 0.772s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:38 devstack sudo[105241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b
Jun 01 02:03:38 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:38 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b" returned: 0 in 0.588s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.512s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115136879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f595f6f-fc60-4dfe-b392-0be4656436fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a724f8ea2b774fdab490c896973f351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:34Z,use_quota=True,user_id='96cf88760ba642e3bb9c8b04bab3fc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Creating volume 4f595f6f-fc60-4dfe-b392-0be4656436fe {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:38 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:38 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe 1073741824
Jun 01 02:03:38 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601138ca-e7a3-4635-93c2-d6cfbac7d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602aff42-9188-4a62-b4dc-0278f38f594b', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f448a35e-5502-4f5f-8b97-8bb1dab805f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:38 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume volume-602aff42-9188-4a62-b4dc-0278f38f594b (602aff42-9188-4a62-b4dc-0278f38f594b): created successfully
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f448a35e-5502-4f5f-8b97-8bb1dab805f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:38 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (ddaa1c63-b668-4195-92de-4b4a1b41d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-c8f5c2ad-5fb0-49aa-96aa-95b3b07a2acc tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created volume successfully.
Jun 01 02:03:39 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe 1073741824" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:39 devstack sudo[105249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe
Jun 01 02:03:39 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:40 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe" returned: 0 in 0.593s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb2b04f-9063-445a-ac15-735820981734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f595f6f-fc60-4dfe-b392-0be4656436fe', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daf12bd-9b2d-4e03-8d6b-6d42a729eb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Volume volume-4f595f6f-fc60-4dfe-b392-0be4656436fe (4f595f6f-fc60-4dfe-b392-0be4656436fe): created successfully
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daf12bd-9b2d-4e03-8d6b-6d42a729eb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Flow 'volume_create_manager' (95dcfb97-7c81-43fa-a533-abe30bacde58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2f5562d8-c9f7-4cb3-8549-6d981fd747b6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created volume successfully.
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-4f595f6f-fc60-4dfe-b392-0be4656436fe-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-4f595f6f-fc60-4dfe-b392-0be4656436fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-quobyte-4f595f6f-fc60-4dfe-b392-0be4656436fe" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-4f595f6f-fc60-4dfe-b392-0be4656436fe" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4488c16-18e2-49a5-8930-0b5dcec33541]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:41 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe
Jun 01 02:03:41 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:41 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:41 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe
Jun 01 02:03:41 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:42 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-4f595f6f-fc60-4dfe-b392-0be4656436fe" returned: 0 in 0.587s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-4f595f6f-fc60-4dfe-b392-0be4656436fe" released by "delete_volume" :: held 1.332s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created reservations ['19dba42e-7ef3-4680-9d5b-96b93ec13b00', '7acca4dc-b59c-44ba-a25b-6ba054976a33', '3005b3fa-d532-42ee-8e6b-f32bb9ce4016', '4bd4face-4740-4b50-9890-37d1ec605931'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:42 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:42 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:42 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.576s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:42 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Deleted volume successfully.
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4bc43ee6-3ddd-4c7e-a1a9-71c1b5435ad7 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-4f595f6f-fc60-4dfe-b392-0be4656436fe-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-602aff42-9188-4a62-b4dc-0278f38f594b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-602aff42-9188-4a62-b4dc-0278f38f594b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-quobyte-602aff42-9188-4a62-b4dc-0278f38f594b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-602aff42-9188-4a62-b4dc-0278f38f594b" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0739b933-945c-46c0-bcb7-c8ec1e51c40d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:43 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b
Jun 01 02:03:43 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:43 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b" returned: 0 in 0.705s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:43 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b
Jun 01 02:03:43 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:44 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-602aff42-9188-4a62-b4dc-0278f38f594b" returned: 0 in 0.604s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-602aff42-9188-4a62-b4dc-0278f38f594b" released by "delete_volume" :: held 1.353s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created reservations ['767c4a18-348e-4f55-839d-3a874a73d6bd', '05039165-0a2a-4741-83e1-f1a78457f927', 'f287cab7-7712-499b-8919-ee14171312af', '55f39f8b-a579-4f35-856c-477f3d8fd617'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:44 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:44 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:45 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.600s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Deleted volume successfully.
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e716c5dd-025d-4bbe-81dd-7b7e1ef9f568 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-602aff42-9188-4a62-b4dc-0278f38f594b-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-quobyte-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[915c26c6-46ec-41c9-bb65-dcc8fb5a4bab]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:45 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f
Jun 01 02:03:45 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:46 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f" returned: 0 in 0.692s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:46 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f
Jun 01 02:03:46 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:46 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f" returned: 0 in 0.598s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f" released by "delete_volume" :: held 1.333s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created reservations ['0ca01bcc-3f17-4639-b8d0-3e98459ce98a', 'edae8561-6977-4848-a250-3396abb5af82', '1c187737-630d-4ac3-a786-1ec4629f8a96', '2a6ec9cf-1707-40b8-9ee1-a660e8d202fd'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:46 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:46 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:47 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.576s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Deleted volume successfully.
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d1a6e9af-0231-43f6-9552-165b8c4d8cb6 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-a9ba989a-94c9-4529-a6c4-b1b4ca67e35f-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-2f56caae-227e-4b14-a257-c805ca5c905d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-2f56caae-227e-4b14-a257-c805ca5c905d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-quobyte-2f56caae-227e-4b14-a257-c805ca5c905d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-2f56caae-227e-4b14-a257-c805ca5c905d" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d04c72-6f60-4288-b3af-1cb1a696cf46]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:47 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d
Jun 01 02:03:47 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:48 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:48 devstack sudo[105293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d
Jun 01 02:03:48 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:48 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2f56caae-227e-4b14-a257-c805ca5c905d" returned: 0 in 0.595s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-2f56caae-227e-4b14-a257-c805ca5c905d" released by "delete_volume" :: held 1.317s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:48 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created reservations ['f340706b-5ff4-4a76-8a69-50bc7f116924', '349f98a5-e9ac-4e74-b504-eccc0cd19228', '5bc24bbd-6244-4d0c-a4fe-657e13611e93', '26cd3103-13dd-40f4-a042-58860ce4a548'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:49 devstack sudo[105296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:49 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:49 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.570s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Deleted volume successfully.
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a51dfdd6-e011-42a1-bbb7-c64162554214 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-2f56caae-227e-4b14-a257-c805ca5c905d-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-6e394e14-7bbc-47e6-b53b-f7e66a7030b0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-6e394e14-7bbc-47e6-b53b-f7e66a7030b0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-quobyte-6e394e14-7bbc-47e6-b53b-f7e66a7030b0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-6e394e14-7bbc-47e6-b53b-f7e66a7030b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbb0c9-2472-4d16-8f55-d6e1bde0b896]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:49 devstack sudo[105299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0
Jun 01 02:03:49 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:50 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0" returned: 0 in 0.709s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:50 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0
Jun 01 02:03:50 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:51 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-6e394e14-7bbc-47e6-b53b-f7e66a7030b0" returned: 0 in 0.596s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-6e394e14-7bbc-47e6-b53b-f7e66a7030b0" released by "delete_volume" :: held 1.350s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created reservations ['53e9a045-d32f-4d57-b503-b8ff0dbcfe68', '7afeffff-bda0-422d-a2e5-504897e24cc3', '7eded309-2022-4097-b088-712baab4915d', 'f6dda2f8-62b1-442f-8028-44294c462f58'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:51 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:51 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:51 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.570s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Deleted volume successfully.
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=81,cinder:INSERT=26,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2f37a70c-f989-41b9-8425-cb328641f230 tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-6e394e14-7bbc-47e6-b53b-f7e66a7030b0-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "cinder-quobyte-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d" acquired by "delete_volume" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b2890e-d783-47b2-b329-54f4e6d79d1a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:52 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d
Jun 01 02:03:52 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:52 devstack sudo[105313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:52 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:52 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d" returned: 0 in 0.722s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:52 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d
Jun 01 02:03:52 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:52 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.588s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:52 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 02:03:53 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d" returned: 0 in 0.594s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-quobyte-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d" released by "delete_volume" :: held 1.355s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Created reservations ['c6835927-136d-4055-9bbe-ad97610897a4', '5d7c37a3-c6cd-4ca7-b06c-280a0614f247', '91054221-c314-4a8d-91ae-e79bb68779cd', '3b594287-5432-43d5-85ca-7028967b37ad'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:53 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:03:53 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:54 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.588s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:03:54 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Deleted volume successfully.
Jun 01 02:03:54 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-fdef3a06-a7c6-43a1-b5d1-07acd511babb tempest-CreateVolumesFromSourceVolumeTest-1347962043 None] Lock "cinder-24ea87d4-3ec0-49e6-af5b-64c760e6ac3d-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Flow 'volume_create_manager' (5a510254-a04d-46c2-b032-e0f40cc859ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fdbe47-3e41-41df-944a-1e0d0919cb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fdbe47-3e41-41df-944a-1e0d0919cb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17018d02-79e5-4ba4-b5eb-6739d143e3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9e20ae05c64d55a6eb351f82d47fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:57Z,use_quota=True,user_id='656ebe04c5cf48e8a76b3ffab8c1d901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8094da62-ae19-4fd5-a621-47250295656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8094da62-ae19-4fd5-a621-47250295656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b75ab6-5e05-45ce-ae7c-74228587ff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b75ab6-5e05-45ce-ae7c-74228587ff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17018d02-79e5-4ba4-b5eb-6739d143e3d5', 'volume_name': 'volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165166da-cf72-4e1e-8e7f-46a3194a782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165166da-cf72-4e1e-8e7f-46a3194a782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efe810e-8e5f-4dfe-a069-9e45c11d1813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:56 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Volume 17018d02-79e5-4ba4-b5eb-6739d143e3d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5', 'volume_size': 1}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17018d02-79e5-4ba4-b5eb-6739d143e3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9e20ae05c64d55a6eb351f82d47fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:57Z,use_quota=True,user_id='656ebe04c5cf48e8a76b3ffab8c1d901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Creating volume 17018d02-79e5-4ba4-b5eb-6739d143e3d5 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:56 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:56 devstack sudo[105370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5 1073741824
Jun 01 02:03:56 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:57 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5 1073741824" returned: 0 in 0.742s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:57 devstack sudo[105375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5
Jun 01 02:03:57 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:03:58 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root
Jun 01 02:03:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5" returned: 0 in 0.590s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:03:58 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:03:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efe810e-8e5f-4dfe-a069-9e45c11d1813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165c53a-53f0-4cdf-956c-410a422bd89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:58 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Volume volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5 (17018d02-79e5-4ba4-b5eb-6739d143e3d5): created successfully
Jun 01 02:03:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165c53a-53f0-4cdf-956c-410a422bd89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:58 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Flow 'volume_create_manager' (5a510254-a04d-46c2-b032-e0f40cc859ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dd362cd7-b0f4-40f0-99e0-f0c7b7f19e4f tempest-CinderUnicodeTest-1190128629 None] Created volume successfully.
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Flow 'volume_create_manager' (370cf318-c2c8-4daf-8d93-53b843e92606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d31529-bc37-4fa9-99c4-264955da0258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d31529-bc37-4fa9-99c4-264955da0258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-845136117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec6ae7e-3252-4bb3-b555-122310c238ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9e20ae05c64d55a6eb351f82d47fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:59Z,use_quota=True,user_id='656ebe04c5cf48e8a76b3ffab8c1d901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f121e8-ee07-436b-a67a-30cd4c4cd06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f121e8-ee07-436b-a67a-30cd4c4cd06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809f6ae6-52ec-48bf-9e61-91380f333daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809f6ae6-52ec-48bf-9e61-91380f333daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec6ae7e-3252-4bb3-b555-122310c238ab', 'volume_name': 'volume-1ec6ae7e-3252-4bb3-b555-122310c238ab', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18de928-f1a8-4827-a027-be1b541f36b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18de928-f1a8-4827-a027-be1b541f36b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7dfd68-3788-463f-b8a1-d1227d7e9d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:03:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Volume 1ec6ae7e-3252-4bb3-b555-122310c238ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec6ae7e-3252-4bb3-b555-122310c238ab', 'volume_size': 1}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:03:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-845136117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec6ae7e-3252-4bb3-b555-122310c238ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9e20ae05c64d55a6eb351f82d47fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:03:59Z,use_quota=True,user_id='656ebe04c5cf48e8a76b3ffab8c1d901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Creating volume 1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:03:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:03:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:03:59 devstack sudo[105378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab 1073741824
Jun 01 02:03:59 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:00 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab 1073741824" returned: 0 in 0.725s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:00 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab
Jun 01 02:04:00 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:00 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab" returned: 0 in 0.589s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7dfd68-3788-463f-b8a1-d1227d7e9d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec6ae7e-3252-4bb3-b555-122310c238ab', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cb7206-86c8-4852-8748-8516204296f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:00 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Volume volume-1ec6ae7e-3252-4bb3-b555-122310c238ab (1ec6ae7e-3252-4bb3-b555-122310c238ab): created successfully
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cb7206-86c8-4852-8748-8516204296f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:00 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Flow 'volume_create_manager' (370cf318-c2c8-4daf-8d93-53b843e92606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7c1ff9d1-53ff-47bd-82d1-5831e1b28b59 tempest-CinderUnicodeTest-1190128629 None] Created volume successfully.
Jun 01 02:04:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Creating offline snapshot b7755e45-1722-436c-a229-695194e865b1 of volume 1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 02:04:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0658cd-62d2-4e2a-93ab-0921d6483ccd]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:01 devstack sudo[105388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab
Jun 01 02:04:01 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:02 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab" returned: 0 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:02 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 1G
Jun 01 02:04:02 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:02 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 1G" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec6ae7e-3252-4bb3-b555-122310c238ab -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:03 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec6ae7e-3252-4bb3-b555-122310c238ab -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1
Jun 01 02:04:03 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:03 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec6ae7e-3252-4bb3-b555-122310c238ab -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1" returned: 0 in 0.631s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:03 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 is being set with open permissions: ugo+rw
Jun 01 02:04:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:03 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1
Jun 01 02:04:03 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:04 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1" returned: 0 in 0.597s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:04 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.info
Jun 01 02:04:04 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:04 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.info" returned: 0 in 0.596s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:04 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.info is being set with open permissions: ugo+rw
Jun 01 02:04:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:04 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.info
Jun 01 02:04:04 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:05 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.info" returned: 0 in 0.576s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.935s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d05aa191-8f0e-47f9-aac6-fbd9b82fe388 tempest-CinderUnicodeTest-1190128629 None] Create snapshot completed successfully
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "cinder-b7755e45-1722-436c-a229-695194e865b1-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-b7755e45-1722-436c-a229-695194e865b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "cinder-quobyte-1ec6ae7e-3252-4bb3-b555-122310c238ab" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-1ec6ae7e-3252-4bb3-b555-122310c238ab" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "cinder-quobyte-b7755e45-1722-436c-a229-695194e865b1" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-b7755e45-1722-436c-a229-695194e865b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Deleting offline snapshot b7755e45-1722-436c-a229-695194e865b1 of volume 1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] snapshot_file for this snap is: volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ffd6c-9326-445e-badb-22b8e7b64de4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:05 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1
Jun 01 02:04:05 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:06 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1" returned: 0 in 0.691s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec6ae7e-3252-4bb3-b555-122310c238ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 02:04:06 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16ba542-b1ea-42a1-8463-da87695218dc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:06 devstack sudo[105418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab
Jun 01 02:04:06 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:07 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab" returned: 0 in 0.688s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:07 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1
Jun 01 02:04:07 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:07 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1" returned: 0 in 0.687s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:07 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1
Jun 01 02:04:07 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:08 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab.b7755e45-1722-436c-a229-695194e865b1" returned: 0 in 0.600s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=123,cinder:SELECT=85,cinder:DELETE=10,cinder:INSERT=32 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-b7755e45-1722-436c-a229-695194e865b1" released by "_delete_snapshot" :: held 2.767s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-1ec6ae7e-3252-4bb3-b555-122310c238ab" released by "delete_snapshot" :: held 2.791s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Created reservations ['0266be95-bc48-4d12-a9cd-bdf788f1dd8e', '4bfc2fcb-cee2-4da9-aaaa-7cb26393fa5a', 'c6041fee-d9ea-4307-91c6-63b9c2009cbf', '70fc3e95-44cb-43c7-b0d0-723f777fd5ed'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:08 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Delete snapshot completed successfully.
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-8ecb0891-791c-4a12-b909-df9fa56bf2b4 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-b7755e45-1722-436c-a229-695194e865b1-delete_snapshot" released by "delete_snapshot" :: held 2.911s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "cinder-1ec6ae7e-3252-4bb3-b555-122310c238ab-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-1ec6ae7e-3252-4bb3-b555-122310c238ab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "cinder-quobyte-1ec6ae7e-3252-4bb3-b555-122310c238ab" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-1ec6ae7e-3252-4bb3-b555-122310c238ab" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[189e263f-04c3-4b1b-bc59-cb654e4c1820]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:09 devstack sudo[105432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab
Jun 01 02:04:09 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:09 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab" returned: 0 in 0.704s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:09 devstack sudo[105437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab
Jun 01 02:04:09 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:10 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1ec6ae7e-3252-4bb3-b555-122310c238ab" returned: 0 in 0.596s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-1ec6ae7e-3252-4bb3-b555-122310c238ab" released by "delete_volume" :: held 1.359s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Created reservations ['e4a4c4d3-78cd-4890-a229-2bd181504aa6', '38762d60-fa41-400a-b8e9-933950c750d0', '7fabea04-cc3b-4af6-982d-bc036c40b6a3', '84bae498-e0b7-484e-87b5-d092b692e705'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:10 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:10 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:10 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.578s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Deleted volume successfully.
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-dd54e47e-67ee-4bf6-a287-ad14c0072e5c tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-1ec6ae7e-3252-4bb3-b555-122310c238ab-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "cinder-17018d02-79e5-4ba4-b5eb-6739d143e3d5-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-17018d02-79e5-4ba4-b5eb-6739d143e3d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "cinder-quobyte-17018d02-79e5-4ba4-b5eb-6739d143e3d5" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-17018d02-79e5-4ba4-b5eb-6739d143e3d5" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8968093a-ec47-4f8e-8f92-e0a5cffd68e0]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:11 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5
Jun 01 02:04:11 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:11 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:11 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5
Jun 01 02:04:11 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:12 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-17018d02-79e5-4ba4-b5eb-6739d143e3d5" returned: 0 in 0.592s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-quobyte-17018d02-79e5-4ba4-b5eb-6739d143e3d5" released by "delete_volume" :: held 1.335s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Created reservations ['e53dba15-1c63-4e89-a331-7121944798cd', '3131fc94-0bb9-4b27-b156-a62bc9acb2ea', '6b7f7a54-71f5-4055-8862-a7d81a3596f9', 'ad6c5169-7726-40ce-8854-492144268141'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:12 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:12 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:13 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.589s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:13 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:13 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Deleted volume successfully.
Jun 01 02:04:13 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f30454d4-be97-4ce6-9666-66133af5c5a9 tempest-CinderUnicodeTest-1190128629 None] Lock "cinder-17018d02-79e5-4ba4-b5eb-6739d143e3d5-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:24 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (29984a6f-0a24-4085-bd66-253f910fae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:24 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357b9146-9d93-4f2d-9e99-6cb72d4b4e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357b9146-9d93-4f2d-9e99-6cb72d4b4e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917387798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e14d55-41db-45ac-9db5-dd76800bb3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:25Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295917c2-fe4c-4686-a4c5-c1a8b0d84f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295917c2-fe4c-4686-a4c5-c1a8b0d84f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ccc3f0-c049-4765-b8b0-f2e1c4154319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ccc3f0-c049-4765-b8b0-f2e1c4154319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e14d55-41db-45ac-9db5-dd76800bb3ef', 'volume_name': 'volume-99e14d55-41db-45ac-9db5-dd76800bb3ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc13a3-0e30-4e8c-952a-4abda3986cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc13a3-0e30-4e8c-952a-4abda3986cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172bc7c3-1116-4221-94d8-e3f3d87a3047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Volume 99e14d55-41db-45ac-9db5-dd76800bb3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e14d55-41db-45ac-9db5-dd76800bb3ef', 'volume_size': 1}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917387798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e14d55-41db-45ac-9db5-dd76800bb3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:25Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Creating volume 99e14d55-41db-45ac-9db5-dd76800bb3ef {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:25 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:25 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef 1073741824
Jun 01 02:04:25 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Flow 'volume_create_manager' (efb4127e-f63f-4a66-8dc1-7e012b0930b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32a5f3b-60a6-4678-988e-9ffb1f635800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32a5f3b-60a6-4678-988e-9ffb1f635800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-35165214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093a23ff-3e1f-4ea1-b3c0-523acd989a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6b42fbb9f24f889f8df2fc8b18787c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:25Z,use_quota=True,user_id='05901032a42a43fba8ef503f6a4980f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd61434d-421a-4101-a88a-5f9ddf52b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd61434d-421a-4101-a88a-5f9ddf52b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf0fae4-ee88-45ec-bf1e-dd99f46fbd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf0fae4-ee88-45ec-bf1e-dd99f46fbd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093a23ff-3e1f-4ea1-b3c0-523acd989a05', 'volume_name': 'volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3059fa46-b7e7-4320-981c-db9388deb67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3059fa46-b7e7-4320-981c-db9388deb67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea5a158-6e19-4597-9967-621139d2040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Volume 093a23ff-3e1f-4ea1-b3c0-523acd989a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05', 'volume_size': 1}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (fdd7e5ae-ba03-44a0-ad17-5bea6307cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1452838-0a04-4a1a-9b9a-c50f33052e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1452838-0a04-4a1a-9b9a-c50f33052e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1514286211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15cb9b8-a526-48cb-bed5-d62a8cc693dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:25Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1d3898-9a16-4313-b6db-7d36696687f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1d3898-9a16-4313-b6db-7d36696687f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502a990e-b359-43cd-9a9c-458429fb09f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502a990e-b359-43cd-9a9c-458429fb09f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15cb9b8-a526-48cb-bed5-d62a8cc693dd', 'volume_name': 'volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455a0098-b49b-4fea-aaa8-c7135b7069cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455a0098-b49b-4fea-aaa8-c7135b7069cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cbbc36-6f0a-479a-98c6-fd5994da8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Volume d15cb9b8-a526-48cb-bed5-d62a8cc693dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd', 'volume_size': 1}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (6ccfd8ee-1f32-43d7-b8d8-d12cd8e7d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d7e88f-163c-4b30-8a0b-8afdbfcd51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d7e88f-163c-4b30-8a0b-8afdbfcd51ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89675245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217cdf37-265f-41fc-b5d8-620660f61c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:26Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f2fa39-cf40-4874-913b-1bb686aaafbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f2fa39-cf40-4874-913b-1bb686aaafbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dc6c4c-7a8a-4ac6-a963-de268f862bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dc6c4c-7a8a-4ac6-a963-de268f862bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217cdf37-265f-41fc-b5d8-620660f61c08', 'volume_name': 'volume-217cdf37-265f-41fc-b5d8-620660f61c08', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79c065f-0432-4106-be39-56de9b2f0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79c065f-0432-4106-be39-56de9b2f0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af24e243-b071-47f9-b40e-e664cf643a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume 217cdf37-265f-41fc-b5d8-620660f61c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217cdf37-265f-41fc-b5d8-620660f61c08', 'volume_size': 1}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (af118ab4-e62e-44e5-bbb2-41296e83b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf565fa-a6da-4418-8dc0-20e0ed1d0646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf565fa-a6da-4418-8dc0-20e0ed1d0646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154130362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9493b7f-31e8-49f7-8cea-5eff76c6cce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:26Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acd017d-c6bf-47b1-b056-4bab56ef75d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acd017d-c6bf-47b1-b056-4bab56ef75d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baaf1812-fc5c-4522-9ad1-77effee171a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baaf1812-fc5c-4522-9ad1-77effee171a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9493b7f-31e8-49f7-8cea-5eff76c6cce3', 'volume_name': 'volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b58152-ce5f-44a0-8650-71015bd8f720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b58152-ce5f-44a0-8650-71015bd8f720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d467bf76-466a-4daa-b748-aad41f356a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:25 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Volume b9493b7f-31e8-49f7-8cea-5eff76c6cce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3', 'volume_size': 1}
Jun 01 02:04:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:26 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef 1073741824" returned: 0 in 1.055s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:26 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef
Jun 01 02:04:26 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (5bf63e55-5110-4c80-bd00-1065b640e9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b956fffc-86c8-4864-9c0e-5e3656d96f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b956fffc-86c8-4864-9c0e-5e3656d96f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-416678804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7e2757-5be4-4036-aabd-b2afaf7cba23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:26Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21d23e4-73d4-45f9-8a1d-474c234c5f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21d23e4-73d4-45f9-8a1d-474c234c5f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4e7d11-6343-4ff9-97b4-03f487b8d012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4e7d11-6343-4ff9-97b4-03f487b8d012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7e2757-5be4-4036-aabd-b2afaf7cba23', 'volume_name': 'volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b9e91-05da-42e7-bd22-9fb95dae1d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b9e91-05da-42e7-bd22-9fb95dae1d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22db8b49-ed08-470e-aac6-a53166733e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Volume cb7e2757-5be4-4036-aabd-b2afaf7cba23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23', 'volume_size': 1}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (4a5e8b1f-266b-4fa9-9f6b-f51ee9756a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57153ad5-516a-419b-b726-6e1570c3b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57153ad5-516a-419b-b726-6e1570c3b86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047945927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10f6ef6-4985-4c5f-96bb-bece12a49d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:27Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ced8ba2-2d72-433e-a255-e099ef80ff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ced8ba2-2d72-433e-a255-e099ef80ff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788a7827-7fe2-4f64-9899-8e63561497f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788a7827-7fe2-4f64-9899-8e63561497f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10f6ef6-4985-4c5f-96bb-bece12a49d93', 'volume_name': 'volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1354a0-f072-4301-a0dc-ae8e51e0b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1354a0-f072-4301-a0dc-ae8e51e0b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb32c89-9336-4d9c-9183-43549aba1ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Volume b10f6ef6-4985-4c5f-96bb-bece12a49d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93', 'volume_size': 1}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:26 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef" returned: 0 in 0.682s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-35165214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093a23ff-3e1f-4ea1-b3c0-523acd989a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6b42fbb9f24f889f8df2fc8b18787c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:25Z,use_quota=True,user_id='05901032a42a43fba8ef503f6a4980f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Creating volume 093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:26 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:26 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 1073741824
Jun 01 02:04:26 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172bc7c3-1116-4221-94d8-e3f3d87a3047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e14d55-41db-45ac-9db5-dd76800bb3ef', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76259faa-06f3-4765-b02c-17202f8a8123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:26 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Volume volume-99e14d55-41db-45ac-9db5-dd76800bb3ef (99e14d55-41db-45ac-9db5-dd76800bb3ef): created successfully
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76259faa-06f3-4765-b02c-17202f8a8123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:26 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (29984a6f-0a24-4085-bd66-253f910fae92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8fbad762-f242-46ec-8684-324eee6b2fd0 tempest-CreateVolumesFromImageTest-49303243 None] Created volume successfully.
Jun 01 02:04:27 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 1073741824" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:27 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05
Jun 01 02:04:27 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:28 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05" returned: 0 in 0.623s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.876s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1514286211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15cb9b8-a526-48cb-bed5-d62a8cc693dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:25Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Creating volume d15cb9b8-a526-48cb-bed5-d62a8cc693dd {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:28 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea5a158-6e19-4597-9967-621139d2040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:28 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd 1073741824
Jun 01 02:04:28 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc2b557-8c50-49db-abba-55986a95aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:28 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Volume volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 (093a23ff-3e1f-4ea1-b3c0-523acd989a05): created successfully
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc2b557-8c50-49db-abba-55986a95aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Flow 'volume_create_manager' (efb4127e-f63f-4a66-8dc1-7e012b0930b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9ccc054e-4620-412f-93b0-f97d2e156f01 tempest-VolumeDependencyTests-2095045564 None] Created volume successfully.
Jun 01 02:04:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Flow 'volume_create_manager' (26dda086-70c7-4855-a1e4-459808d4a17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8689dfde-d221-4016-8b63-ac973ef059a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8689dfde-d221-4016-8b63-ac973ef059a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc23c7d-2d75-4663-b4fa-13bae412175b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea23db77b945420a98ddb36caf630ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:29Z,use_quota=True,user_id='bd16a6bda9114dc3b8798bea5103e4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f302b50-6e58-4b0d-9496-d85587ad59af),volume_type_id=3f302b50-6e58-4b0d-9496-d85587ad59af)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4168c96-9e55-4816-bced-6d78ab6721df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4168c96-9e55-4816-bced-6d78ab6721df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17a00dc-1d20-43dc-8ab1-6777fdee25f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 02:04:29 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd 1073741824" returned: 0 in 0.888s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:29 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd
Jun 01 02:04:29 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17a00dc-1d20-43dc-8ab1-6777fdee25f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbc23c7d-2d75-4663-b4fa-13bae412175b', 'volume_name': 'volume-cbc23c7d-2d75-4663-b4fa-13bae412175b', 'volume_size': 1, 'image_id': '6c397489-9f29-4780-aca3-d11859137645', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c397489-9f29-4780-aca3-d11859137645', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e91344798c5abc83f0d39b8a9e11120', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea23db77b945420a98ddb36caf630ecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4391eefbae09580e56deb8d472138d87c8a0f5bdf3d3b23a6d3284621b6397503f74199e2b19749d3ea84783e32716ba3f2b54925edbd823da6f9ea003c7b228', 'id': '6c397489-9f29-4780-aca3-d11859137645', 'created_at': datetime.datetime(2026, 6, 1, 0, 4, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 0, 4, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c397489-9f29-4780-aca3-d11859137645/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b257dd0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f7db2a-5648-4dba-b18d-03e363ca8271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f7db2a-5648-4dba-b18d-03e363ca8271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bab1c8-d29d-4976-b821-05c78d920f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Volume cbc23c7d-2d75-4663-b4fa-13bae412175b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbc23c7d-2d75-4663-b4fa-13bae412175b', 'volume_size': 1, 'image_id': '6c397489-9f29-4780-aca3-d11859137645', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c397489-9f29-4780-aca3-d11859137645', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e91344798c5abc83f0d39b8a9e11120', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea23db77b945420a98ddb36caf630ecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4391eefbae09580e56deb8d472138d87c8a0f5bdf3d3b23a6d3284621b6397503f74199e2b19749d3ea84783e32716ba3f2b54925edbd823da6f9ea003c7b228', 'id': '6c397489-9f29-4780-aca3-d11859137645', 'created_at': datetime.datetime(2026, 6, 1, 0, 4, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 0, 4, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c397489-9f29-4780-aca3-d11859137645/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b257dd0>}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Trying to clone cbc23c7d-2d75-4663-b4fa-13bae412175b from image 6c397489-9f29-4780-aca3-d11859137645 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c397489-9f29-4780-aca3-d11859137645', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 02:04:29 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Image download 0.00 MB at 0.00 MB/s
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[94536f6b-a2f1-4e74-a704-8c36c6fd2f6e]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:29 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD
Jun 01 02:04:29 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:29 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd" returned: 0 in 0.590s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.044s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89675245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217cdf37-265f-41fc-b5d8-620660f61c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:26Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Creating volume 217cdf37-265f-41fc-b5d8-620660f61c08 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:29 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cbbc36-6f0a-479a-98c6-fd5994da8477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0f1d8c-7554-4f0f-9945-25eb95edc640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:29 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08 1073741824
Jun 01 02:04:29 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:29 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Volume volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd (d15cb9b8-a526-48cb-bed5-d62a8cc693dd): created successfully
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0f1d8c-7554-4f0f-9945-25eb95edc640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:29 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (fdd7e5ae-ba03-44a0-ad17-5bea6307cf93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:29 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7f3dfdcd-fd5d-40a5-b195-d83fafdc4a5c tempest-CreateVolumesFromImageTest-49303243 None] Created volume successfully.
Jun 01 02:04:30 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:30 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD
Jun 01 02:04:30 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:30 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08 1073741824" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:30 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08
Jun 01 02:04:30 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:30 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD" returned: 1 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Temporary image 6c397489-9f29-4780-aca3-d11859137645 is fetched for user bd16a6bda9114dc3b8798bea5103e4d5. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7186b4-6256-45d8-a279-24589afd99b9]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:31 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD
Jun 01 02:04:31 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:31 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08" returned: 0 in 0.619s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.392s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154130362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9493b7f-31e8-49f7-8cea-5eff76c6cce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:26Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Creating volume b9493b7f-31e8-49f7-8cea-5eff76c6cce3 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:31 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af24e243-b071-47f9-b40e-e664cf643a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217cdf37-265f-41fc-b5d8-620660f61c08', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:31 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3 1073741824
Jun 01 02:04:31 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2187b2e6-5c9e-475f-9e90-44d01455be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:31 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume volume-217cdf37-265f-41fc-b5d8-620660f61c08 (217cdf37-265f-41fc-b5d8-620660f61c08): created successfully
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2187b2e6-5c9e-475f-9e90-44d01455be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (6ccfd8ee-1f32-43d7-b8d8-d12cd8e7d168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-62be6c18-479f-4452-8333-98caf9a29a30 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created volume successfully.
Jun 01 02:04:31 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:31 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD
Jun 01 02:04:31 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:32 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3 1073741824" returned: 0 in 0.828s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:32 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3
Jun 01 02:04:32 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:32 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD" returned: 1 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (cc924172-7437-4359-9faf-303643d6d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424efade-427a-473d-9d4c-e3ab17fb9a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424efade-427a-473d-9d4c-e3ab17fb9a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-932127116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb101090-e045-4d89-8786-8f70591cef8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:33Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93175493-3a59-41c4-b94a-061effaad0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93175493-3a59-41c4-b94a-061effaad0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16737628-b5d6-4790-8909-d7a9c8e30d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16737628-b5d6-4790-8909-d7a9c8e30d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb101090-e045-4d89-8786-8f70591cef8e', 'volume_name': 'volume-cb101090-e045-4d89-8786-8f70591cef8e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8bded8-f92f-4957-b29e-cb0190112d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8bded8-f92f-4957-b29e-cb0190112d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4220dec-2e49-432c-92b8-d4972c7617dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume cb101090-e045-4d89-8786-8f70591cef8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb101090-e045-4d89-8786-8f70591cef8e', 'volume_size': 1}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:32 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3" returned: 0 in 0.624s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.458s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-416678804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7e2757-5be4-4036-aabd-b2afaf7cba23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:26Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Creating volume cb7e2757-5be4-4036-aabd-b2afaf7cba23 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:32 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:32 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23 1073741824
Jun 01 02:04:32 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d467bf76-466a-4daa-b748-aad41f356a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d86c9c-84b1-4b73-b583-5b0ce74cdc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (150e382e-82c3-4fef-931b-66cbb503a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986dfb13-9d7c-4c2c-b73a-44d22ab84a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:32 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Volume volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3 (b9493b7f-31e8-49f7-8cea-5eff76c6cce3): created successfully
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d86c9c-84b1-4b73-b583-5b0ce74cdc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (af118ab4-e62e-44e5-bbb2-41296e83b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:32 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986dfb13-9d7c-4c2c-b73a-44d22ab84a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-198139393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29f200a-46a2-43b5-b97c-9296076133ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:33Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed4881d-084f-43d0-a905-83c7d1403d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed4881d-084f-43d0-a905-83c7d1403d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166f265e-f3fb-49cf-825c-baef55e0d04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166f265e-f3fb-49cf-825c-baef55e0d04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29f200a-46a2-43b5-b97c-9296076133ce', 'volume_name': 'volume-a29f200a-46a2-43b5-b97c-9296076133ce', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37978780-9935-4d17-b43e-ab5f23508a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37978780-9935-4d17-b43e-ab5f23508a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f04db0-5d69-4787-b8e5-3671207a8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume a29f200a-46a2-43b5-b97c-9296076133ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29f200a-46a2-43b5-b97c-9296076133ce', 'volume_size': 1}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:33 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-65d7372f-1dfc-423a-afdc-9e69eaa14f2c tempest-CreateVolumesFromImageTest-49303243 None] Created volume successfully.
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (cc8243f9-750a-4bf6-a629-c3b3c2838ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42295a21-c6e6-453c-afe7-6dc19c22f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42295a21-c6e6-453c-afe7-6dc19c22f261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132112376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f194e395-64f2-4471-a196-bb1cb53a75f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:33Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bdd479-762a-4b6c-ac63-efe449f03962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bdd479-762a-4b6c-ac63-efe449f03962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be42c16-743c-4928-83d2-ba2db24dcca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be42c16-743c-4928-83d2-ba2db24dcca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f194e395-64f2-4471-a196-bb1cb53a75f0', 'volume_name': 'volume-f194e395-64f2-4471-a196-bb1cb53a75f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd97886-3fb7-4c63-8475-81cfa7c85180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd97886-3fb7-4c63-8475-81cfa7c85180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356d1753-aed5-4ee0-816b-8d32c8e7c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume f194e395-64f2-4471-a196-bb1cb53a75f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f194e395-64f2-4471-a196-bb1cb53a75f0', 'volume_size': 1}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (546d534c-5658-4aca-ad94-c8cad683b502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be330ff6-df7b-4f60-bca1-2b2225930395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be330ff6-df7b-4f60-bca1-2b2225930395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691550796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f486070-48c1-4160-ab82-e644c39c705a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:34Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840799cf-617a-4bcd-9910-372113b6f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840799cf-617a-4bcd-9910-372113b6f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f505a7-a12a-4155-8077-e2d1c6d6df29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f505a7-a12a-4155-8077-e2d1c6d6df29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f486070-48c1-4160-ab82-e644c39c705a', 'volume_name': 'volume-1f486070-48c1-4160-ab82-e644c39c705a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9c4650-12bb-48ed-8c4b-ff3e34c9ea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9c4650-12bb-48ed-8c4b-ff3e34c9ea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b33e7c-bc5b-4767-9b9f-4f20c598bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:33 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume 1f486070-48c1-4160-ab82-e644c39c705a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f486070-48c1-4160-ab82-e644c39c705a', 'volume_size': 1}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:33 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23 1073741824" returned: 0 in 0.919s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:33 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23
Jun 01 02:04:33 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (0eb38ea3-00e0-4d4d-86f9-a7c5a5bb49c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:33 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7998c02a-d7b5-4e24-b4fe-aee47098e6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7998c02a-d7b5-4e24-b4fe-aee47098e6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47258202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c7d2ff-2c45-41e4-a586-0c5df0ad9853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:34Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf4c71d-a0d1-4351-bdb7-d1fd91ebd9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf4c71d-a0d1-4351-bdb7-d1fd91ebd9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8d0f03-be16-483d-8544-dbfd5cd3a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8d0f03-be16-483d-8544-dbfd5cd3a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c7d2ff-2c45-41e4-a586-0c5df0ad9853', 'volume_name': 'volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1e2b0a-fc25-42c9-9d52-a70ad164e154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1e2b0a-fc25-42c9-9d52-a70ad164e154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc4504c-7c9e-4712-9e92-4728a1e28e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume 71c7d2ff-2c45-41e4-a586-0c5df0ad9853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853', 'volume_size': 1}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:34 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23" returned: 0 in 0.634s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.738s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047945927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10f6ef6-4985-4c5f-96bb-bece12a49d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ce5a1cf22b4712bfb0150b96993b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:27Z,use_quota=True,user_id='84423f7b69214197a765260f7c88b65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Creating volume b10f6ef6-4985-4c5f-96bb-bece12a49d93 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:34 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22db8b49-ed08-470e-aac6-a53166733e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:34 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93 1073741824
Jun 01 02:04:34 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea36038-a279-4d13-8c8a-e62f3081f56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:34 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Volume volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23 (cb7e2757-5be4-4036-aabd-b2afaf7cba23): created successfully
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea36038-a279-4d13-8c8a-e62f3081f56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:34 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (5bf63e55-5110-4c80-bd00-1065b640e9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7d80676f-a01a-4f9b-bd84-172a7dcbc023 tempest-CreateVolumesFromImageTest-49303243 None] Created volume successfully.
Jun 01 02:04:35 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93 1073741824" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:35 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93
Jun 01 02:04:35 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:35 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93" returned: 0 in 0.585s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.080s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Creating offline snapshot f21269e1-0851-4d90-971a-f6c3b1f36873 of volume 093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb32c89-9336-4d9c-9183-43549aba1ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d742b2d4-cfe2-4350-93c9-cd4722462fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c241b1d4-40b0-43c1-b6d0-771a11c36262]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Volume volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93 (b10f6ef6-4985-4c5f-96bb-bece12a49d93): created successfully
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d742b2d4-cfe2-4350-93c9-cd4722462fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Flow 'volume_create_manager' (4a5e8b1f-266b-4fa9-9f6b-f51ee9756a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:35 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-34209fc1-e0fa-4ee7-86d5-aab6c5f8d0ca tempest-CreateVolumesFromImageTest-49303243 None] Created volume successfully.
Jun 01 02:04:35 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05
Jun 01 02:04:35 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-b10f6ef6-4985-4c5f-96bb-bece12a49d93-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-b10f6ef6-4985-4c5f-96bb-bece12a49d93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:36 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:36 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 1G
Jun 01 02:04:36 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-quobyte-b10f6ef6-4985-4c5f-96bb-bece12a49d93" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-b10f6ef6-4985-4c5f-96bb-bece12a49d93" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ba2832-a911-495f-a28a-52959e88bf68]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:36 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93
Jun 01 02:04:36 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:37 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93" returned: 0 in 0.719s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:37 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93
Jun 01 02:04:37 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:37 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 1G" returned: 0 in 0.839s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:37 devstack sudo[105598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873
Jun 01 02:04:37 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:38 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b10f6ef6-4985-4c5f-96bb-bece12a49d93" returned: 0 in 0.643s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-b10f6ef6-4985-4c5f-96bb-bece12a49d93" released by "delete_volume" :: held 1.409s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:38 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:38 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 is being set with open permissions: ugo+rw
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:38 devstack sudo[105605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Created reservations ['275b0df9-a38b-4af3-9eec-368e9bc42fd9', 'd99f7146-2dc4-469d-8b79-9277e61c94f1', '4ad963b9-8804-465e-a14c-61cf117ead31', 'e9b39ded-572a-4ecb-a668-bbb32c02e0d6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:38 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:38 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:38 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:38 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873" returned: 0 in 0.612s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:38 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.info
Jun 01 02:04:38 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-cb7e2757-5be4-4036-aabd-b2afaf7cba23-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:38 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:38 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Deleted volume successfully.
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-cb7e2757-5be4-4036-aabd-b2afaf7cba23-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-60a01ac1-be8d-44c4-a876-38f2369bfa55 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-b10f6ef6-4985-4c5f-96bb-bece12a49d93-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-quobyte-cb7e2757-5be4-4036-aabd-b2afaf7cba23" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-cb7e2757-5be4-4036-aabd-b2afaf7cba23" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c493e6-ff39-494e-aee3-10a5b336f532]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:39 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23
Jun 01 02:04:39 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:39 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.info" returned: 0 in 0.631s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:39 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.info is being set with open permissions: ugo+rw
Jun 01 02:04:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:39 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.info
Jun 01 02:04:39 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:39 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23" returned: 0 in 0.741s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:39 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23
Jun 01 02:04:39 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:39 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.info" returned: 0 in 0.601s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.163s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.613s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc23c7d-2d75-4663-b4fa-13bae412175b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea23db77b945420a98ddb36caf630ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:29Z,use_quota=True,user_id='bd16a6bda9114dc3b8798bea5103e4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f302b50-6e58-4b0d-9496-d85587ad59af),volume_type_id=3f302b50-6e58-4b0d-9496-d85587ad59af)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Creating volume cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:40 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:40 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b 1073741824
Jun 01 02:04:40 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:40 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-46afc7ea-46ea-4a3c-92ad-512f9e2c52de tempest-VolumeDependencyTests-2095045564 None] Create snapshot completed successfully
Jun 01 02:04:40 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb7e2757-5be4-4036-aabd-b2afaf7cba23" returned: 0 in 0.593s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-cb7e2757-5be4-4036-aabd-b2afaf7cba23" released by "delete_volume" :: held 1.382s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Created reservations ['637cf773-2b3b-4c4c-b10f-91342bedac86', '71bd080a-742d-488c-bab0-d3c5cc3c9255', '74a9c9d6-77b1-4da6-b5b6-126595cbcb37', 'cd01810f-ae8d-432f-a9be-3c324088b267'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:40 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:40 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Flow 'volume_create_manager' (f965278d-b617-4cd0-a8a6-da5f9ce484b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e72e54-26a1-4f75-844c-ca2e2243a1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e72e54-26a1-4f75-844c-ca2e2243a1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-753102726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd14f1c-6a72-489b-b612-126c987c7199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6b42fbb9f24f889f8df2fc8b18787c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f21269e1-0851-4d90-971a-f6c3b1f36873,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:41Z,use_quota=True,user_id='05901032a42a43fba8ef503f6a4980f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb772be0-2bf3-4297-8165-be018694af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb772be0-2bf3-4297-8165-be018694af56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff71a64e-60ad-4a27-9f98-8e0698c85549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff71a64e-60ad-4a27-9f98-8e0698c85549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2cd14f1c-6a72-489b-b612-126c987c7199', 'volume_name': 'volume-2cd14f1c-6a72-489b-b612-126c987c7199', 'volume_size': 1, 'snapshot_id': 'f21269e1-0851-4d90-971a-f6c3b1f36873'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16c4865-743c-413f-a70b-a6ffeb6cf8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16c4865-743c-413f-a70b-a6ffeb6cf8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcdc032-d7a9-40d0-bfdb-71c9c0eecb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:40 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Volume 2cd14f1c-6a72-489b-b612-126c987c7199: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2cd14f1c-6a72-489b-b612-126c987c7199', 'volume_size': 1, 'snapshot_id': 'f21269e1-0851-4d90-971a-f6c3b1f36873'}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:40 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b 1073741824" returned: 0 in 0.853s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:40 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b
Jun 01 02:04:40 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:41 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-b9493b7f-31e8-49f7-8cea-5eff76c6cce3-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:41 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Deleted volume successfully.
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-b9493b7f-31e8-49f7-8cea-5eff76c6cce3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-64ec3096-2426-490d-92eb-880bfc0f6d89 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-cb7e2757-5be4-4036-aabd-b2afaf7cba23-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-quobyte-b9493b7f-31e8-49f7-8cea-5eff76c6cce3" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-b9493b7f-31e8-49f7-8cea-5eff76c6cce3" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac454343-b7e8-4545-88b3-a20930e616a7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:41 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3
Jun 01 02:04:41 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:41 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.904s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-932127116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb101090-e045-4d89-8786-8f70591cef8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:33Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Creating volume cb101090-e045-4d89-8786-8f70591cef8e {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:41 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:41 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e 1073741824
Jun 01 02:04:41 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Attempting download of 6c397489-9f29-4780-aca3-d11859137645 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c397489-9f29-4780-aca3-d11859137645', 'metadata': {}}])) to volume cbc23c7d-2d75-4663-b4fa-13bae412175b. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[883101c6-f04c-491d-8633-2b3d7abc3785]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c397489-9f29-4780-aca3-d11859137645__cog2vqd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:41 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c397489-9f29-4780-aca3-d11859137645__cog2vqd
Jun 01 02:04:41 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:41 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3" returned: 0 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:41 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3
Jun 01 02:04:41 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:42 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c397489-9f29-4780-aca3-d11859137645__cog2vqd" returned: 0 in 0.708s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c397489-9f29-4780-aca3-d11859137645__cog2vqd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:42 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e 1073741824" returned: 0 in 0.838s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:42 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e
Jun 01 02:04:42 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:42 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c397489-9f29-4780-aca3-d11859137645__cog2vqd
Jun 01 02:04:42 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:42 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9493b7f-31e8-49f7-8cea-5eff76c6cce3" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-b9493b7f-31e8-49f7-8cea-5eff76c6cce3" released by "delete_volume" :: held 1.472s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Created reservations ['2ffdfac7-5864-47a9-bd87-cf0ceeeb2aba', 'd8fdb8f4-3540-4822-a4ee-35570908794e', 'f91cb53d-e9d6-4e5c-85ab-7dc5e27881c7', '831ba77a-f411-49ac-97ca-8dc94b23e9a0'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:42 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:42 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:43 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e" returned: 0 in 0.619s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.053s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-198139393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29f200a-46a2-43b5-b97c-9296076133ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:33Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Creating volume a29f200a-46a2-43b5-b97c-9296076133ce {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:43 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:43 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce 1073741824
Jun 01 02:04:43 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4220dec-2e49-432c-92b8-d4972c7617dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb101090-e045-4d89-8786-8f70591cef8e', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de128035-8a8c-40fc-b8dc-e76d1592a8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:43 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c397489-9f29-4780-aca3-d11859137645__cog2vqd" returned: 1 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c397489-9f29-4780-aca3-d11859137645__cog2vqd' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:04:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume volume-cb101090-e045-4d89-8786-8f70591cef8e (cb101090-e045-4d89-8786-8f70591cef8e): created successfully
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de128035-8a8c-40fc-b8dc-e76d1592a8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (cc924172-7437-4359-9faf-303643d6d01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdf783f-e21a-49d2-9509-a211352340f9]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-30d4ed1d-ada9-430d-9381-e94c910a7b17 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created volume successfully.
Jun 01 02:04:43 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD
Jun 01 02:04:43 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-d15cb9b8-a526-48cb-bed5-d62a8cc693dd-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-d15cb9b8-a526-48cb-bed5-d62a8cc693dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-quobyte-d15cb9b8-a526-48cb-bed5-d62a8cc693dd" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-d15cb9b8-a526-48cb-bed5-d62a8cc693dd" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:43 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.731s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd89043-f1a7-4eef-a0a1-eb5a9d1abb7f]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Deleted volume successfully.
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d7a33a05-c538-4459-b50f-c704c72dac98 tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-b9493b7f-31e8-49f7-8cea-5eff76c6cce3-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:43 devstack sudo[105669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd
Jun 01 02:04:43 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:43 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce 1073741824" returned: 0 in 0.835s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:44 devstack sudo[105676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce
Jun 01 02:04:44 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:44 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:44 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD
Jun 01 02:04:44 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:44 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd" returned: 0 in 0.762s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:44 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd
Jun 01 02:04:44 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:44 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce" returned: 0 in 0.613s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.231s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132112376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f194e395-64f2-4471-a196-bb1cb53a75f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:33Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Creating volume f194e395-64f2-4471-a196-bb1cb53a75f0 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:44 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f04db0-5d69-4787-b8e5-3671207a8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29f200a-46a2-43b5-b97c-9296076133ce', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf6de3c-8e4a-44f0-ab86-4dd048f24fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:44 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0 1073741824
Jun 01 02:04:44 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume volume-a29f200a-46a2-43b5-b97c-9296076133ce (a29f200a-46a2-43b5-b97c-9296076133ce): created successfully
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf6de3c-8e4a-44f0-ab86-4dd048f24fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (150e382e-82c3-4fef-931b-66cbb503a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:44 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-12226323-2b51-4f48-b888-21de62d91b3a tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created volume successfully.
Jun 01 02:04:44 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD" returned: 1 in 0.752s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] 6c397489-9f29-4780-aca3-d11859137645 was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:44 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b
Jun 01 02:04:44 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:44 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d15cb9b8-a526-48cb-bed5-d62a8cc693dd" returned: 0 in 0.683s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-d15cb9b8-a526-48cb-bed5-d62a8cc693dd" released by "delete_volume" :: held 1.507s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Created reservations ['246c64d2-6338-4561-9db7-5f777ef4c31e', '9d241708-5347-4d96-83b8-3593a5d9a712', '9a6ac642-c5db-45f7-9135-74b5b5859685', 'e04d8875-60d2-4347-9099-96af7ba2fd09'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:45 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:45 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:45 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0 1073741824" returned: 0 in 0.833s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:45 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:45 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0
Jun 01 02:04:45 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c397489-9f29-4780-aca3-d11859137645_5fn6ywojdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 02:04:45 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Converted 0.00 MB image at 0.00 MB/s
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:45 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b 1G
Jun 01 02:04:45 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-99e14d55-41db-45ac-9db5-dd76800bb3ef-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-99e14d55-41db-45ac-9db5-dd76800bb3ef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "cinder-quobyte-99e14d55-41db-45ac-9db5-dd76800bb3ef" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-99e14d55-41db-45ac-9db5-dd76800bb3ef" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98680c-b898-48dd-b23f-75a9228a2c7a]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:45 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:45 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Deleted volume successfully.
Jun 01 02:04:45 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-46faa5d9-3a2b-412a-b776-5587fb78abcf tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-d15cb9b8-a526-48cb-bed5-d62a8cc693dd-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:45 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef
Jun 01 02:04:45 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:46 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0" returned: 0 in 0.689s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.467s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691550796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f486070-48c1-4160-ab82-e644c39c705a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:34Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Creating volume 1f486070-48c1-4160-ab82-e644c39c705a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:46 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356d1753-aed5-4ee0-816b-8d32c8e7c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f194e395-64f2-4471-a196-bb1cb53a75f0', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:46 devstack sudo[105713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a 1073741824
Jun 01 02:04:46 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832a137d-9dee-4f49-82a4-49dc192f9d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:46 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume volume-f194e395-64f2-4471-a196-bb1cb53a75f0 (f194e395-64f2-4471-a196-bb1cb53a75f0): created successfully
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832a137d-9dee-4f49-82a4-49dc192f9d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (cc8243f9-750a-4bf6-a629-c3b3c2838ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:46 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7b348cd7-459a-4ea6-a312-e4477c4a5276 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created volume successfully.
Jun 01 02:04:46 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b 1G" returned: 0 in 0.784s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d8289f-adf2-412a-9eed-50e7effdf81f]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:46 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b
Jun 01 02:04:46 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:46 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef" returned: 0 in 0.783s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:46 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:46 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef
Jun 01 02:04:46 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:46 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a 1073741824" returned: 0 in 0.818s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:47 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a
Jun 01 02:04:47 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:47 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b" returned: 0 in 0.749s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:47 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99e14d55-41db-45ac-9db5-dd76800bb3ef" returned: 0 in 0.669s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:47 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b
Jun 01 02:04:47 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-quobyte-99e14d55-41db-45ac-9db5-dd76800bb3ef" released by "delete_volume" :: held 1.508s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Created reservations ['599c0687-6269-4d44-b27b-1f12ef506376', 'b230544a-5706-40a7-a3bc-a414091e879f', '89d0d3f0-069d-4985-8c63-cfd758e47dad', '06611f56-20af-4be2-a693-931e51f0a1b4'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:47 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:47 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:47 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a" returned: 0 in 0.627s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.623s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47258202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c7d2ff-2c45-41e4-a586-0c5df0ad9853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c127513f68420481c8d6d2421a69c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:34Z,use_quota=True,user_id='7ad18627475f4d80846382aae225e2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Creating volume 71c7d2ff-2c45-41e4-a586-0c5df0ad9853 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:47 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:47 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853 1073741824
Jun 01 02:04:47 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b33e7c-bc5b-4767-9b9f-4f20c598bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f486070-48c1-4160-ab82-e644c39c705a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54fb136-d2e0-4661-999c-8a00b1ce1f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:47 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume volume-1f486070-48c1-4160-ab82-e644c39c705a (1f486070-48c1-4160-ab82-e644c39c705a): created successfully
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54fb136-d2e0-4661-999c-8a00b1ce1f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (546d534c-5658-4aca-ad94-c8cad683b502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:47 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8f603145-e523-4dbf-b7b4-3e9b5b00271d tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created volume successfully.
Jun 01 02:04:47 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b" returned: 1 in 0.792s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Downloaded image 6c397489-9f29-4780-aca3-d11859137645 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c397489-9f29-4780-aca3-d11859137645', 'metadata': {}}])) to volume cbc23c7d-2d75-4663-b4fa-13bae412175b successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Temporary image 6c397489-9f29-4780-aca3-d11859137645 for user bd16a6bda9114dc3b8798bea5103e4d5 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Marking volume cbc23c7d-2d75-4663-b4fa-13bae412175b as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Copying metadata from image 6c397489-9f29-4780-aca3-d11859137645 to cbc23c7d-2d75-4663-b4fa-13bae412175b. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Creating volume glance metadata for volume cbc23c7d-2d75-4663-b4fa-13bae412175b backed by image 6c397489-9f29-4780-aca3-d11859137645 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6c397489-9f29-4780-aca3-d11859137645', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7e91344798c5abc83f0d39b8a9e11120', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bab1c8-d29d-4976-b821-05c78d920f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc23c7d-2d75-4663-b4fa-13bae412175b', 'volume_size': 1, 'image_id': '6c397489-9f29-4780-aca3-d11859137645', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c397489-9f29-4780-aca3-d11859137645', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e91344798c5abc83f0d39b8a9e11120', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea23db77b945420a98ddb36caf630ecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4391eefbae09580e56deb8d472138d87c8a0f5bdf3d3b23a6d3284621b6397503f74199e2b19749d3ea84783e32716ba3f2b54925edbd823da6f9ea003c7b228', 'id': '6c397489-9f29-4780-aca3-d11859137645', 'created_at': datetime.datetime(2026, 6, 1, 0, 4, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 0, 4, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c397489-9f29-4780-aca3-d11859137645/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b257dd0>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:47 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868f93de-f11b-45ce-87f4-6f465920fc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:48 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Volume volume-cbc23c7d-2d75-4663-b4fa-13bae412175b (cbc23c7d-2d75-4663-b4fa-13bae412175b): created successfully
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868f93de-f11b-45ce-87f4-6f465920fc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Flow 'volume_create_manager' (26dda086-70c7-4855-a1e4-459808d4a17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-141ee43c-03a7-4d32-92d2-1ec1aea04195 tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Created volume successfully.
Jun 01 02:04:48 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.765s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:48 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Deleted volume successfully.
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-3252c180-0482-4aae-9e35-cec9b4a7269b tempest-CreateVolumesFromImageTest-49303243 None] Lock "cinder-99e14d55-41db-45ac-9db5-dd76800bb3ef-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Acquiring lock "cinder-cbc23c7d-2d75-4663-b4fa-13bae412175b-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "cinder-cbc23c7d-2d75-4663-b4fa-13bae412175b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Acquiring lock "cinder-quobyte-cbc23c7d-2d75-4663-b4fa-13bae412175b" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "cinder-quobyte-cbc23c7d-2d75-4663-b4fa-13bae412175b" acquired by "delete_volume" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0d652-daeb-4e5d-990d-9356322be7ee]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:48 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b
Jun 01 02:04:48 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:48 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853 1073741824" returned: 0 in 0.957s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:48 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:48 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853
Jun 01 02:04:48 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:49 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b" returned: 0 in 0.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:49 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853" returned: 0 in 0.732s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.614s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-quobyte-f21269e1-0851-4d90-971a-f6c3b1f36873-2cd14f1c-6a72-489b-b612-126c987c7199" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc4504c-7c9e-4712-9e92-4728a1e28e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ccf273-4a78-44ae-b312-71d9e631201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:49 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b
Jun 01 02:04:49 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-f21269e1-0851-4d90-971a-f6c3b1f36873-2cd14f1c-6a72-489b-b612-126c987c7199" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Creating volume 2cd14f1c-6a72-489b-b612-126c987c7199 from snapshot f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-quobyte-2cd14f1c-6a72-489b-b612-126c987c7199" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:49 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Volume volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853 (71c7d2ff-2c45-41e4-a586-0c5df0ad9853): created successfully
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ccf273-4a78-44ae-b312-71d9e631201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Flow 'volume_create_manager' (0eb38ea3-00e0-4d4d-86f9-a7c5a5bb49c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-2cd14f1c-6a72-489b-b612-126c987c7199" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] snapshot: f21269e1-0851-4d90-971a-f6c3b1f36873, volume: 2cd14f1c-6a72-489b-b612-126c987c7199,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:49 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-b231dc48-ed6b-46ca-9199-f927519f0531 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created volume successfully.
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3382a55e-6a3a-430f-b59b-51e878f51906]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:49 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:49 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873
Jun 01 02:04:49 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:50 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b" returned: 1 in 0.754s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:50 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b
Jun 01 02:04:50 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:50 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873" returned: 0 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[558e1204-1f91-4184-a264-3425adafced4]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-71c7d2ff-2c45-41e4-a586-0c5df0ad9853-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-71c7d2ff-2c45-41e4-a586-0c5df0ad9853-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-quobyte-71c7d2ff-2c45-41e4-a586-0c5df0ad9853" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-71c7d2ff-2c45-41e4-a586-0c5df0ad9853" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f564ca76-518c-4a64-8b74-1d6c44559785]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:50 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05
Jun 01 02:04:50 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:50 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853
Jun 01 02:04:50 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:50 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cbc23c7d-2d75-4663-b4fa-13bae412175b" returned: 0 in 0.814s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:50 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "cinder-quobyte-cbc23c7d-2d75-4663-b4fa-13bae412175b" released by "delete_volume" :: held 2.523s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Created reservations ['afd919e5-081d-4a62-a4c1-3b193186a332', 'a112bb9a-7d2d-4b87-ab09-f1cf0332b256', 'ab9bb803-25a2-41d2-bb5c-a4412ed6eab4', '5c37f2d1-6bdb-428f-ad61-431696584562'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:51 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:51 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (7a1d082a-5f68-485d-ba6f-51c78e2bd376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e985318-9749-4d3d-a69b-1a1cc98e87d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e985318-9749-4d3d-a69b-1a1cc98e87d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-806851123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086ff288-4695-4668-bc17-8cb558837876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:51Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16da7d9-dc04-40e8-b383-e88b25cd2186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16da7d9-dc04-40e8-b383-e88b25cd2186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1097873d-bb54-40bd-8c90-1540375a2563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1097873d-bb54-40bd-8c90-1540375a2563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086ff288-4695-4668-bc17-8cb558837876', 'volume_name': 'volume-086ff288-4695-4668-bc17-8cb558837876', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208092f6-0405-4666-9a9b-c8ec5444e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208092f6-0405-4666-9a9b-c8ec5444e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39005f3-9e8b-4292-9f1a-6f51d3a8e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume 086ff288-4695-4668-bc17-8cb558837876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086ff288-4695-4668-bc17-8cb558837876', 'volume_size': 1}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:51 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05" returned: 0 in 0.980s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:51 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853" returned: 0 in 0.840s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:51 devstack sudo[105779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199
Jun 01 02:04:51 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:51 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853
Jun 01 02:04:51 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:51 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.766s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Deleted volume successfully.
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=98,cinder:INSERT=33,cinder:UPDATE=126,cinder:DELETE=13 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:04:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4fbc7a6f-5bdc-4b5a-b0c7-5303b162772c tempest-VolumeAndVolumeTypeFromImageTest-1518178428 None] Lock "cinder-cbc23c7d-2d75-4663-b4fa-13bae412175b-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:52 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-71c7d2ff-2c45-41e4-a586-0c5df0ad9853" returned: 0 in 0.748s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-71c7d2ff-2c45-41e4-a586-0c5df0ad9853" released by "delete_volume" :: held 1.644s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created reservations ['9954f311-9d91-4512-8e1d-62e7cbbe6f22', '6cad842d-6bee-4e08-b248-e2a52021c52c', 'e9ade711-4dfa-4387-b938-5a44b7bb6462', 'e52cd929-c2fa-4cf5-8373-fc26cc4a8ac1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:52 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:52 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:52 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:52 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-1f486070-48c1-4160-ab82-e644c39c705a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-1f486070-48c1-4160-ab82-e644c39c705a-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-quobyte-1f486070-48c1-4160-ab82-e644c39c705a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-1f486070-48c1-4160-ab82-e644c39c705a" acquired by "delete_volume" :: waited 0.055s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0721dba5-7225-48a4-a18f-3a991b652d4d]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:53 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.399s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Deleted volume successfully.
Jun 01 02:04:53 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a
Jun 01 02:04:53 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:53 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-59ac0d0d-91a7-40a5-87f1-bd918f8fea49 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-71c7d2ff-2c45-41e4-a586-0c5df0ad9853-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:54 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 1.786s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:54 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:54 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:04:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 02:04:54 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 02:04:55 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a" returned: 0 in 2.061s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:55 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a
Jun 01 02:04:55 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:57 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-1f486070-48c1-4160-ab82-e644c39c705a" returned: 0 in 1.493s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-1f486070-48c1-4160-ab82-e644c39c705a" released by "delete_volume" :: held 3.706s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created reservations ['68343f43-58a6-43ab-85ea-121225b6495f', '2eeb2bca-d9d2-452f-bb14-bf459588074c', '09ebbe59-e840-41b3-85c1-37fb15a19214', '54fa03da-0944-4cd7-8de7-4933cf2b2eac'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:57 devstack sudo[105855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:57 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-f194e395-64f2-4471-a196-bb1cb53a75f0-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-f194e395-64f2-4471-a196-bb1cb53a75f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:57 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199" returned: 0 in 6.564s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b2fd94-5c83-44ce-927c-d36c26afbd02]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-quobyte-f194e395-64f2-4471-a196-bb1cb53a75f0" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-f194e395-64f2-4471-a196-bb1cb53a75f0" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b6b13a-40c3-41a7-86fe-27a1c599103b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:58 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05
Jun 01 02:04:58 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:58 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0
Jun 01 02:04:58 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:58 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.902s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:04:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Deleted volume successfully.
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-15a7fea2-9cd5-43d2-a1cb-1fb685b85e31 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-1f486070-48c1-4160-ab82-e644c39c705a-delete_volume" released by "delete_volume" :: held 5.261s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:58 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0" returned: 0 in 0.854s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:58 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0
Jun 01 02:04:58 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:59 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05" returned: 0 in 1.039s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 02:04:59 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Converted 1024.00 MB image at 155.95 MB/s
Jun 01 02:04:59 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199 is being set with open permissions: ugo+rw
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:59 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199
Jun 01 02:04:59 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:59 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-f194e395-64f2-4471-a196-bb1cb53a75f0" returned: 0 in 0.668s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-f194e395-64f2-4471-a196-bb1cb53a75f0" released by "delete_volume" :: held 1.593s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:59 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199" returned: 0 in 0.638s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-2cd14f1c-6a72-489b-b612-126c987c7199" released by "_copy_volume_from_snapshot" :: held 10.152s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created reservations ['b432e61b-760c-48cf-b616-f0962c31652f', '2c0cf103-615a-45a1-8ae8-71ab07ff15ad', '40ea2e27-5644-4f01-8ac2-ec7e9cc6ac20', 'cb52ba67-261d-464a-b9ed-14eed9ccb931'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-f21269e1-0851-4d90-971a-f6c3b1f36873-2cd14f1c-6a72-489b-b612-126c987c7199" released by "_create_volume_from_snapshot" :: held 10.211s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.261s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.320s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-806851123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086ff288-4695-4668-bc17-8cb558837876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:04:51Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Creating volume 086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:04:59 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:59 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 1073741824
Jun 01 02:04:59 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcdc032-d7a9-40d0-bfdb-71c9c0eecb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd14f1c-6a72-489b-b612-126c987c7199', 'volume_size': 1, 'snapshot_id': 'f21269e1-0851-4d90-971a-f6c3b1f36873'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ffb6a3-8796-4409-865f-2ad5f69b1c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:04:59 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Volume volume-2cd14f1c-6a72-489b-b612-126c987c7199 (2cd14f1c-6a72-489b-b612-126c987c7199): created successfully
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ffb6a3-8796-4409-865f-2ad5f69b1c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Flow 'volume_create_manager' (f965278d-b617-4cd0-a8a6-da5f9ce484b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:04:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:04:59 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1d787fa4-324b-45dd-a200-20e64c02a4a2 tempest-VolumeDependencyTests-2095045564 None] Created volume successfully.
Jun 01 02:04:59 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:04:59 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-a29f200a-46a2-43b5-b97c-9296076133ce-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-a29f200a-46a2-43b5-b97c-9296076133ce-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-quobyte-a29f200a-46a2-43b5-b97c-9296076133ce" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-a29f200a-46a2-43b5-b97c-9296076133ce" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[48056e86-be20-475b-bbea-3317b70b3a36]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:00 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.711s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Deleted volume successfully.
Jun 01 02:05:00 devstack sudo[105881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce
Jun 01 02:05:00 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-9ff09cb9-0d0e-4684-8ec8-ba524d001229 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-f194e395-64f2-4471-a196-bb1cb53a75f0-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-f21269e1-0851-4d90-971a-f6c3b1f36873-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-f21269e1-0851-4d90-971a-f6c3b1f36873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-quobyte-093a23ff-3e1f-4ea1-b3c0-523acd989a05" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-093a23ff-3e1f-4ea1-b3c0-523acd989a05" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-quobyte-f21269e1-0851-4d90-971a-f6c3b1f36873" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-f21269e1-0851-4d90-971a-f6c3b1f36873" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Deleting offline snapshot f21269e1-0851-4d90-971a-f6c3b1f36873 of volume 093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] snapshot_file for this snap is: volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49467ee-2c80-46c0-bfae-8bb644dd706c]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:00 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 1073741824" returned: 0 in 1.076s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:00 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876
Jun 01 02:05:00 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:00 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873
Jun 01 02:05:00 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:01 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce" returned: 0 in 0.854s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:01 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce
Jun 01 02:05:01 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:01 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876" returned: 0 in 0.723s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:01 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873" returned: 0 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39005f3-9e8b-4292-9f1a-6f51d3a8e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086ff288-4695-4668-bc17-8cb558837876', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3179062c-e4a5-4459-9b41-4610b38ed187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caabb2d-b9d7-450d-81da-b6c4be6a04b6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:01 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume volume-086ff288-4695-4668-bc17-8cb558837876 (086ff288-4695-4668-bc17-8cb558837876): created successfully
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3179062c-e4a5-4459-9b41-4610b38ed187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:01 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (7a1d082a-5f68-485d-ba6f-51c78e2bd376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:01 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-10422181-52a3-46d0-88fa-9a7e7b494368 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created volume successfully.
Jun 01 02:05:01 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05
Jun 01 02:05:01 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:02 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-a29f200a-46a2-43b5-b97c-9296076133ce" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-a29f200a-46a2-43b5-b97c-9296076133ce" released by "delete_volume" :: held 1.693s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created reservations ['594b8d07-dd11-45b1-adbc-f46d57f932a0', '66fe1863-0ba0-49d6-9fb5-fc7e615819a3', '786e1b43-73a7-4b5d-9066-799ec0ec9c70', '20c71feb-b080-41fb-a01c-bd9269a2d94f'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:02 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:02 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:02 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:02 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873
Jun 01 02:05:02 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Creating offline snapshot eeafe528-53ad-415f-a543-6e03783d98cd of volume 086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-cb101090-e045-4d89-8786-8f70591cef8e-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3107df96-f167-420e-9199-b1a301225748]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-cb101090-e045-4d89-8786-8f70591cef8e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-quobyte-cb101090-e045-4d89-8786-8f70591cef8e" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:02 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Flow 'volume_create_manager' (7918c23c-6619-4938-a8ee-f0e1f3a4d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75232429-4eda-4ef4-804c-1e18f578f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-cb101090-e045-4d89-8786-8f70591cef8e" acquired by "delete_volume" :: waited 0.054s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.780s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:02 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:02 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876
Jun 01 02:05:02 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Deleted volume successfully.
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75232429-4eda-4ef4-804c-1e18f578f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fea84cb-d947-4ab2-bb84-f8dd3c3fade6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26232e0cc63481c90c6c385fbdadeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:03Z,use_quota=True,user_id='bfbfe94b9b594dad8abbc0eb63493a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13674561-72e5-4843-8f75-5814ef352483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13674561-72e5-4843-8f75-5814ef352483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20690f1-c74f-47ad-942c-2704ba830b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.image.glance [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Creating Keystone auth plugin from conf {{(pid=86676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd2ce05-b30a-48b8-9637-c77183bd4437]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-7fddca7b-6b27-47fd-807b-442be73c8bc1 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-a29f200a-46a2-43b5-b97c-9296076133ce-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:03 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e
Jun 01 02:05:03 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20690f1-c74f-47ad-942c-2704ba830b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2fea84cb-d947-4ab2-bb84-f8dd3c3fade6', 'volume_name': 'volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6', 'volume_size': 1, 'image_id': 'f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5104e0d2b5980882f65b43e2e2549e0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b26232e0cc63481c90c6c385fbdadeaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ffe04b03826bfa608cd42ef9c9a78e1a6154769cc34bc7964a0e321f6cb71bfccab5d407475d9dc013ebd3af27792e78c33f9ccd8c7008a734bf22427405faa', 'id': 'f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'created_at': datetime.datetime(2026, 6, 1, 0, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 0, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b086060>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f82d2d4-c0c2-4990-aab3-6b695a07a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f82d2d4-c0c2-4990-aab3-6b695a07a53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd85084-3da1-4ae4-8772-46fdd5736c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:03 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Volume 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6', 'volume_size': 1, 'image_id': 'f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5104e0d2b5980882f65b43e2e2549e0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b26232e0cc63481c90c6c385fbdadeaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ffe04b03826bfa608cd42ef9c9a78e1a6154769cc34bc7964a0e321f6cb71bfccab5d407475d9dc013ebd3af27792e78c33f9ccd8c7008a734bf22427405faa', 'id': 'f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'created_at': datetime.datetime(2026, 6, 1, 0, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 0, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b086060>}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Trying to clone 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 from image f78da464-0a3d-4a4f-92e3-19c96f026f7f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'metadata': {}}]). {{(pid=86676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 01 02:05:03 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873" returned: 0 in 1.007s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:03 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873
Jun 01 02:05:03 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 01 02:05:03 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Image download 0.00 MB at 0.00 MB/s
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7785701f-cb3e-44df-a242-cf674561ed18]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:03 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD
Jun 01 02:05:03 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:03 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876" returned: 0 in 0.983s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:03 devstack sudo[105933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd 1G
Jun 01 02:05:03 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:03 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e" returned: 0 in 0.807s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:03 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e
Jun 01 02:05:03 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:04 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05.f21269e1-0851-4d90-971a-f6c3b1f36873" returned: 0 in 0.716s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-f21269e1-0851-4d90-971a-f6c3b1f36873" released by "_delete_snapshot" :: held 3.410s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-093a23ff-3e1f-4ea1-b3c0-523acd989a05" released by "delete_snapshot" :: held 3.444s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Created reservations ['ce91cbe6-4b05-49da-a485-27d336ce3aba', 'f728d3b8-2dea-44df-a1a0-936e5a4e27c0', '464a83f1-a56c-4d5a-9058-bf3e99ba46df', 'fc14ab17-23bd-4ce6-8402-8d986de15809'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:04 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Delete snapshot completed successfully.
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-454cd465-473a-4217-9dab-b4794c70127a tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-f21269e1-0851-4d90-971a-f6c3b1f36873-delete_snapshot" released by "delete_snapshot" :: held 3.641s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:04 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD
Jun 01 02:05:04 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:04 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-cb101090-e045-4d89-8786-8f70591cef8e" returned: 0 in 0.686s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-cb101090-e045-4d89-8786-8f70591cef8e" released by "delete_volume" :: held 1.575s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created reservations ['05657000-9a26-483d-8ce8-94c0020ef8c6', 'e6510ab6-b5be-42f2-a015-8e02916aef2f', '8a968ae5-210e-4f38-9385-2153b05b34f2', 'ad62e736-a03e-4faf-ade2-0229cbf0a02d'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:04 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd 1G" returned: 0 in 0.913s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086ff288-4695-4668-bc17-8cb558837876 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:04 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:04 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:04 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086ff288-4695-4668-bc17-8cb558837876 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd
Jun 01 02:05:04 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-093a23ff-3e1f-4ea1-b3c0-523acd989a05-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-093a23ff-3e1f-4ea1-b3c0-523acd989a05-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:05 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Temporary image f78da464-0a3d-4a4f-92e3-19c96f026f7f is fetched for user bfbfe94b9b594dad8abbc0eb63493a45. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-quobyte-093a23ff-3e1f-4ea1-b3c0-523acd989a05" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-093a23ff-3e1f-4ea1-b3c0-523acd989a05" acquired by "delete_volume" :: waited 0.037s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-217cdf37-265f-41fc-b5d8-620660f61c08-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-217cdf37-265f-41fc-b5d8-620660f61c08-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7107cfe-4e9a-4cab-a31c-241c355bde1e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6699a4e8-0fd4-4254-94ec-cf7fd4aa55fe]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "cinder-quobyte-217cdf37-265f-41fc-b5d8-620660f61c08" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:05 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05
Jun 01 02:05:05 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-217cdf37-265f-41fc-b5d8-620660f61c08" acquired by "delete_volume" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[009a54b5-7243-4c91-8f93-8e852e3d10b7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:05 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD
Jun 01 02:05:05 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:05 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08
Jun 01 02:05:05 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:05 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.942s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:05 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Deleted volume successfully.
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-144ad8b0-e910-463c-84bc-f42090055b07 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-cb101090-e045-4d89-8786-8f70591cef8e-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:05 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086ff288-4695-4668-bc17-8cb558837876 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd" returned: 0 in 1.019s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:05 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd is being set with open permissions: ugo+rw
Jun 01 02:05:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:05 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd
Jun 01 02:05:05 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:06 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:06 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05" returned: 0 in 0.878s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:06 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05
Jun 01 02:05:06 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:06 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD
Jun 01 02:05:06 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:06 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08" returned: 0 in 0.883s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:06 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08
Jun 01 02:05:06 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:06 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:06 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.info
Jun 01 02:05:06 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:06 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-093a23ff-3e1f-4ea1-b3c0-523acd989a05" returned: 0 in 0.680s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-093a23ff-3e1f-4ea1-b3c0-523acd989a05" released by "delete_volume" :: held 1.661s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Created reservations ['69523318-8249-4f5f-a112-be121380075b', '7fed6224-311e-4f45-b22e-fc21721929bd', '5b18a181-4074-4d78-aec1-eeee1f2085ef', '0216367a-5296-4b15-96a2-1617795971be'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:06 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:06 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:06 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD" returned: 1 in 0.853s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:06 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-217cdf37-265f-41fc-b5d8-620660f61c08" returned: 0 in 0.655s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-quobyte-217cdf37-265f-41fc-b5d8-620660f61c08" released by "delete_volume" :: held 1.609s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Created reservations ['e520fd21-b97f-4d94-8d3e-6e27000405de', 'b20179bf-dfe1-4c77-9a4c-1d1c297168a7', '14ae275b-3f14-4d0d-903f-d5bb27d4d18a', '532df166-e4e4-44d2-94d9-09103a87c8ad'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:07 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.info" returned: 0 in 0.654s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:07 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.info is being set with open permissions: ugo+rw
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:07 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.info
Jun 01 02:05:07 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:07 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:07 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-2cd14f1c-6a72-489b-b612-126c987c7199-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-2cd14f1c-6a72-489b-b612-126c987c7199-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "cinder-quobyte-2cd14f1c-6a72-489b-b612-126c987c7199" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-2cd14f1c-6a72-489b-b612-126c987c7199" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47c5302-b144-4b47-9a86-85939ff26c18]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:07 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:07 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.791s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:07 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Deleted volume successfully.
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-343c3eb4-8437-42ec-a3b6-072f9ceed5ea tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-093a23ff-3e1f-4ea1-b3c0-523acd989a05-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:07 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.info" returned: 0 in 0.700s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.130s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fea84cb-d947-4ab2-bb84-f8dd3c3fade6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26232e0cc63481c90c6c385fbdadeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:03Z,use_quota=True,user_id='bfbfe94b9b594dad8abbc0eb63493a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Creating volume 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:07 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-9e8ddbb2-0cbb-4c85-9178-c224a973d822 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Create snapshot completed successfully
Jun 01 02:05:07 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 1073741824
Jun 01 02:05:07 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:07 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.871s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:07 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Deleted volume successfully.
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a7c537e7-ee0e-4887-bfa1-9d0db5df7148 tempest-CreateVolumesFromSourceVolumeTest-737653848 None] Lock "cinder-217cdf37-265f-41fc-b5d8-620660f61c08-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=130,cinder:INSERT=43,cinder:UPDATE=180,cinder:DELETE=19 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:08 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (e438501c-1ac7-4875-a6a4-2550211d32b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b726b13-cd94-4873-8fc9-f0993a075057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199" returned: 0 in 1.161s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b726b13-cd94-4873-8fc9-f0993a075057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910789929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aecb69-5796-4d97-aa39-d52ca9f64200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:08Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:08 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199
Jun 01 02:05:08 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4b1487-a403-4fe2-aef7-978199508671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4b1487-a403-4fe2-aef7-978199508671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f94777-dd62-4a3f-b38f-967f1035bfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f94777-dd62-4a3f-b38f-967f1035bfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99aecb69-5796-4d97-aa39-d52ca9f64200', 'volume_name': 'volume-99aecb69-5796-4d97-aa39-d52ca9f64200', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7230ba8-7be2-4199-8c51-e4374bab3cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7230ba8-7be2-4199-8c51-e4374bab3cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56acf108-5f8b-4841-8e56-d70b8e3297cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:08 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume 99aecb69-5796-4d97-aa39-d52ca9f64200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99aecb69-5796-4d97-aa39-d52ca9f64200', 'volume_size': 1}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:08 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 1073741824" returned: 0 in 1.092s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:08 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:09 devstack sudo[106011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6
Jun 01 02:05:09 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (91c50a58-7e68-4253-abe7-fb02fb1fbb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751a693f-8ff4-4696-986e-a7d5845ec193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751a693f-8ff4-4696-986e-a7d5845ec193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538214362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab052bd-58a9-40e2-b727-2579fdcd22d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:09Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6389a6a6-745f-45ca-907f-48dd2315590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6389a6a6-745f-45ca-907f-48dd2315590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd7cf03-5075-4ebc-8bb8-c0edaec31f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd7cf03-5075-4ebc-8bb8-c0edaec31f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab052bd-58a9-40e2-b727-2579fdcd22d9', 'volume_name': 'volume-bab052bd-58a9-40e2-b727-2579fdcd22d9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5441acc6-0329-4837-a68d-c6dc65764d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5441acc6-0329-4837-a68d-c6dc65764d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3916c353-fcbb-42ee-a68c-a883e9d14ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume bab052bd-58a9-40e2-b727-2579fdcd22d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab052bd-58a9-40e2-b727-2579fdcd22d9', 'volume_size': 1}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:09 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2cd14f1c-6a72-489b-b612-126c987c7199" returned: 0 in 0.891s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-quobyte-2cd14f1c-6a72-489b-b612-126c987c7199" released by "delete_volume" :: held 2.142s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (27935c4b-e584-47ab-9f58-b45dad97fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32564c1c-a792-4edd-902b-d0a48e989dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32564c1c-a792-4edd-902b-d0a48e989dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094919313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63528963-97a2-401d-af6a-6addfad45e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:09Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2289c31e-265c-48be-8011-e01c7025e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2289c31e-265c-48be-8011-e01c7025e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1a5a81-b820-41ed-b75c-911ab109a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1a5a81-b820-41ed-b75c-911ab109a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63528963-97a2-401d-af6a-6addfad45e86', 'volume_name': 'volume-63528963-97a2-401d-af6a-6addfad45e86', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f040cb-6ae8-4212-9a0c-1061bf544b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f040cb-6ae8-4212-9a0c-1061bf544b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d254f0c-2495-4da2-8a9c-e877ed9c33da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:09 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume 63528963-97a2-401d-af6a-6addfad45e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63528963-97a2-401d-af6a-6addfad45e86', 'volume_size': 1}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Created reservations ['d3b1417f-3435-4152-a8f3-6feeb4985ed1', '26d592c6-fd73-4894-b52e-a711a557926a', '43942a7c-e08b-4b2a-bacf-55fa752086a8', 'd0921e4a-228d-4b25-a29b-27c32c78ac62'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:09 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" returned: 0 in 0.880s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910789929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aecb69-5796-4d97-aa39-d52ca9f64200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:08Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Creating volume 99aecb69-5796-4d97-aa39-d52ca9f64200 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:09 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:09 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:09 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:09 devstack sudo[106016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200 1073741824
Jun 01 02:05:09 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:09 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Attempting download of f78da464-0a3d-4a4f-92e3-19c96f026f7f ((None, [{'url': 'file:///opt/stack/data/glance/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'metadata': {}}])) to volume 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (646d43fb-8016-42a6-ab46-12980435b781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa05418-b693-4126-934d-6993fccb037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f76357-6fce-4c89-91e2-31e65a223812]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa05418-b693-4126-934d-6993fccb037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131903212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2c857e-3462-4579-96a9-daefea2d7a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:10Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2ec344-723a-4489-a7f4-8f7c18181b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2ec344-723a-4489-a7f4-8f7c18181b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee259b4-638a-47af-a4fc-3f9b3249dc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee259b4-638a-47af-a4fc-3f9b3249dc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2c857e-3462-4579-96a9-daefea2d7a16', 'volume_name': 'volume-9b2c857e-3462-4579-96a9-daefea2d7a16', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e13f073-9721-4708-9961-b8360ecd3480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e13f073-9721-4708-9961-b8360ecd3480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6c0bb3-3299-43fd-a96c-789069386dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume 9b2c857e-3462-4579-96a9-daefea2d7a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2c857e-3462-4579-96a9-daefea2d7a16', 'volume_size': 1}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78da464-0a3d-4a4f-92e3-19c96f026f7f_20d2x69l {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:10 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78da464-0a3d-4a4f-92e3-19c96f026f7f_20d2x69l
Jun 01 02:05:10 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (5732a638-563e-4cc1-8f26-00838f477b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ea58ba-6dac-4107-8799-44809d97c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ea58ba-6dac-4107-8799-44809d97c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431965095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b312e-cce7-40ef-bfc7-5543bb195f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:11Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b5d245-fd77-450a-8a02-717bf9e5910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b5d245-fd77-450a-8a02-717bf9e5910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7756e9-76ad-44fd-9b6e-1977892c65ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7756e9-76ad-44fd-9b6e-1977892c65ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97b312e-cce7-40ef-bfc7-5543bb195f58', 'volume_name': 'volume-d97b312e-cce7-40ef-bfc7-5543bb195f58', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21403c61-c979-48cc-9e06-5e3b39b7bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21403c61-c979-48cc-9e06-5e3b39b7bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6b56ff-5a9c-4900-ba82-697da52bb20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:10 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume d97b312e-cce7-40ef-bfc7-5543bb195f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97b312e-cce7-40ef-bfc7-5543bb195f58', 'volume_size': 1}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.979s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:10 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Deleted volume successfully.
Jun 01 02:05:10 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a8367df7-3959-4176-b6ee-315124dbeda3 tempest-VolumeDependencyTests-2095045564 None] Lock "cinder-2cd14f1c-6a72-489b-b612-126c987c7199-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78da464-0a3d-4a4f-92e3-19c96f026f7f_20d2x69l" returned: 0 in 1.017s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78da464-0a3d-4a4f-92e3-19c96f026f7f_20d2x69l {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:11 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:11 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200 1073741824" returned: 0 in 1.296s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:11 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200
Jun 01 02:05:11 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:11 devstack sudo[106029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78da464-0a3d-4a4f-92e3-19c96f026f7f_20d2x69l
Jun 01 02:05:11 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:11 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78da464-0a3d-4a4f-92e3-19c96f026f7f_20d2x69l" returned: 1 in 0.794s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78da464-0a3d-4a4f-92e3-19c96f026f7f_20d2x69l' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc7ade-7a9a-4df5-b4fe-7f916caf0c52]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:11 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:12 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200" returned: 0 in 0.805s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.798s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538214362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab052bd-58a9-40e2-b727-2579fdcd22d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:09Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Creating volume bab052bd-58a9-40e2-b727-2579fdcd22d9 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:12 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:12 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD
Jun 01 02:05:12 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56acf108-5f8b-4841-8e56-d70b8e3297cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aecb69-5796-4d97-aa39-d52ca9f64200', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:12 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9 1073741824
Jun 01 02:05:12 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c4a865-e528-4572-baf1-b24ea82bafbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:12 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume volume-99aecb69-5796-4d97-aa39-d52ca9f64200 (99aecb69-5796-4d97-aa39-d52ca9f64200): created successfully
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c4a865-e528-4572-baf1-b24ea82bafbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (e438501c-1ac7-4875-a6a4-2550211d32b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:12 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-fa37981f-45e1-45ba-83e8-5f1a34f08480 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created volume successfully.
Jun 01 02:05:12 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD" returned: 0 in 0.893s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:12 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:13 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD
Jun 01 02:05:13 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:13 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9 1073741824" returned: 0 in 1.184s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:13 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9
Jun 01 02:05:13 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:13 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD" returned: 1 in 0.748s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] f78da464-0a3d-4a4f-92e3-19c96f026f7f was raw, converting to raw {{(pid=86676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:13 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6
Jun 01 02:05:13 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:13 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9" returned: 0 in 0.650s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.267s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094919313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63528963-97a2-401d-af6a-6addfad45e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:09Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Creating volume 63528963-97a2-401d-af6a-6addfad45e86 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:13 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:13 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:14 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86 1073741824
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3916c353-fcbb-42ee-a68c-a883e9d14ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab052bd-58a9-40e2-b727-2579fdcd22d9', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:14 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a467b1-3ad0-4d77-925b-fce457d8dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:14 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume volume-bab052bd-58a9-40e2-b727-2579fdcd22d9 (bab052bd-58a9-40e2-b727-2579fdcd22d9): created successfully
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a467b1-3ad0-4d77-925b-fce457d8dd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (91c50a58-7e68-4253-abe7-fb02fb1fbb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:14 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-de001446-bff5-43b8-aae3-37a51f17a1a8 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created volume successfully.
Jun 01 02:05:14 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" returned: 0 in 0.759s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f78da464-0a3d-4a4f-92e3-19c96f026f7f_hpdjzv3edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 02:05:14 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Converted 0.00 MB image at 0.00 MB/s
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:14 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 1G
Jun 01 02:05:14 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:14 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86 1073741824" returned: 0 in 0.903s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:14 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:14 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86
Jun 01 02:05:14 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:15 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 1G" returned: 0 in 0.728s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422120e-faf2-41ad-84a2-1dffe5efd51e]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:15 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6
Jun 01 02:05:15 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:15 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86" returned: 0 in 0.672s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.424s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131903212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2c857e-3462-4579-96a9-daefea2d7a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:10Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Creating volume 9b2c857e-3462-4579-96a9-daefea2d7a16 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:15 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:15 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16 1073741824
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d254f0c-2495-4da2-8a9c-e877ed9c33da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63528963-97a2-401d-af6a-6addfad45e86', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:15 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335d2124-08f0-439f-9852-554f38531801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:15 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume volume-63528963-97a2-401d-af6a-6addfad45e86 (63528963-97a2-401d-af6a-6addfad45e86): created successfully
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335d2124-08f0-439f-9852-554f38531801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (27935c4b-e584-47ab-9f58-b45dad97fb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:15 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-343220ef-7ee7-4c71-ade6-7d25d13ced83 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created volume successfully.
Jun 01 02:05:15 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:15 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:16 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6
Jun 01 02:05:16 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:16 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16 1073741824" returned: 0 in 0.977s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:16 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16
Jun 01 02:05:16 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:16 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" returned: 1 in 0.946s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Downloaded image f78da464-0a3d-4a4f-92e3-19c96f026f7f ((None, [{'url': 'file:///opt/stack/data/glance/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'metadata': {}}])) to volume 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 successfully. {{(pid=86676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Temporary image f78da464-0a3d-4a4f-92e3-19c96f026f7f for user bfbfe94b9b594dad8abbc0eb63493a45 is deleted. {{(pid=86676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.volume_utils [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Marking volume 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 as bootable. {{(pid=86676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Copying metadata from image f78da464-0a3d-4a4f-92e3-19c96f026f7f to 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6. {{(pid=86676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Creating volume glance metadata for volume 2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 backed by image f78da464-0a3d-4a4f-92e3-19c96f026f7f with: {'image_id': 'f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a5104e0d2b5980882f65b43e2e2549e0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd85084-3da1-4ae4-8772-46fdd5736c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6', 'volume_size': 1, 'image_id': 'f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5104e0d2b5980882f65b43e2e2549e0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b26232e0cc63481c90c6c385fbdadeaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ffe04b03826bfa608cd42ef9c9a78e1a6154769cc34bc7964a0e321f6cb71bfccab5d407475d9dc013ebd3af27792e78c33f9ccd8c7008a734bf22427405faa', 'id': 'f78da464-0a3d-4a4f-92e3-19c96f026f7f', 'created_at': datetime.datetime(2026, 6, 1, 0, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 1, 0, 5, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78da464-0a3d-4a4f-92e3-19c96f026f7f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72864b086060>}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce945595-9427-498f-b274-8a5f176b53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:16 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Volume volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 (2fea84cb-d947-4ab2-bb84-f8dd3c3fade6): created successfully
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce945595-9427-498f-b274-8a5f176b53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:16 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Flow 'volume_create_manager' (7918c23c-6619-4938-a8ee-f0e1f3a4d288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:16 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2c7fe3d0-2294-4816-9937-d887d5d8e9cd tempest-VolumeImageDependencyTests-1517895584 None] Created volume successfully.
Jun 01 02:05:17 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16" returned: 0 in 0.640s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.448s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431965095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b312e-cce7-40ef-bfc7-5543bb195f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0e5c5a2bf2477b86e2bb81539e5ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:11Z,use_quota=True,user_id='2b01571b9ecd4e5183c99a45a552495b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Creating volume d97b312e-cce7-40ef-bfc7-5543bb195f58 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:17 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6c0bb3-3299-43fd-a96c-789069386dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2c857e-3462-4579-96a9-daefea2d7a16', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5f9ef1-4d08-499d-bbd5-a9df1db5d1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:17 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58 1073741824
Jun 01 02:05:17 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:17 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume volume-9b2c857e-3462-4579-96a9-daefea2d7a16 (9b2c857e-3462-4579-96a9-daefea2d7a16): created successfully
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5f9ef1-4d08-499d-bbd5-a9df1db5d1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (646d43fb-8016-42a6-ab46-12980435b781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:17 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e0ee2497-5097-4f9e-b63a-29e9b1f0eb78 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created volume successfully.
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Acquiring lock "cinder-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Lock "cinder-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Acquiring lock "cinder-quobyte-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Lock "cinder-quobyte-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc4bfe1-f76a-4b45-a293-a651abb4e086]: (4, 'raw') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:17 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:17 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6
Jun 01 02:05:17 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:18 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58 1073741824" returned: 0 in 0.875s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:18 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58
Jun 01 02:05:18 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:18 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" returned: 0 in 0.841s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:18 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6
Jun 01 02:05:18 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:18 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58" returned: 0 in 0.630s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6b56ff-5a9c-4900-ba82-697da52bb20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97b312e-cce7-40ef-bfc7-5543bb195f58', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1a53c4-07df-46c8-b264-bf11bc65a044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:18 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Volume volume-d97b312e-cce7-40ef-bfc7-5543bb195f58 (d97b312e-cce7-40ef-bfc7-5543bb195f58): created successfully
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1a53c4-07df-46c8-b264-bf11bc65a044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:18 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Flow 'volume_create_manager' (5732a638-563e-4cc1-8f26-00838f477b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:18 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2918e393-65e6-476d-aac1-6bf0204c370f tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created volume successfully.
Jun 01 02:05:19 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" returned: 1 in 0.827s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6' failed. Not Retrying. {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:19 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6
Jun 01 02:05:19 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-d97b312e-cce7-40ef-bfc7-5543bb195f58-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-d97b312e-cce7-40ef-bfc7-5543bb195f58-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-d97b312e-cce7-40ef-bfc7-5543bb195f58" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-d97b312e-cce7-40ef-bfc7-5543bb195f58" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8739bb-d5d3-41ae-ab83-2056bacb7ac7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:19 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" returned: 0 in 0.641s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:19 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58
Jun 01 02:05:19 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Lock "cinder-quobyte-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6" released by "delete_volume" :: held 2.386s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:19 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Created reservations ['b83f2768-6728-42e3-a909-533cbf7dd815', 'b0ead61a-3f53-4d3b-818a-7ff4f509d107', 'c63c9840-e7cd-4657-834f-f8d61aa5b057', '43739b2e-34ca-4d8a-a29f-23b2cd37a8e8'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:20 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:20 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:20 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58" returned: 0 in 0.788s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:20 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58
Jun 01 02:05:20 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:20 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.661s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:20 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Deleted volume successfully.
Jun 01 02:05:20 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-bf49b995-52f0-4cb3-92a8-8e51700924af tempest-VolumeImageDependencyTests-1517895584 None] Lock "cinder-2fea84cb-d947-4ab2-bb84-f8dd3c3fade6-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:21 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d97b312e-cce7-40ef-bfc7-5543bb195f58" returned: 0 in 0.706s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-d97b312e-cce7-40ef-bfc7-5543bb195f58" released by "delete_volume" :: held 1.543s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created reservations ['02bd4a90-5363-4f4f-8824-64f194bb3372', '78760144-72ea-4311-96b0-4f14d78549d5', '081ed288-6b0d-42f4-a2ae-a22d6a2d602a', 'f0f13062-f134-4bd6-8119-fdb369f55fb2'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:21 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:21 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:21 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-9b2c857e-3462-4579-96a9-daefea2d7a16-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-9b2c857e-3462-4579-96a9-daefea2d7a16-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-9b2c857e-3462-4579-96a9-daefea2d7a16" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:22 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.694s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:22 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Deleted volume successfully.
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-9b2c857e-3462-4579-96a9-daefea2d7a16" acquired by "delete_volume" :: waited 0.021s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-4e5335fc-0ea4-4f49-a9ac-46b8e56ec5b2 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-d97b312e-cce7-40ef-bfc7-5543bb195f58-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9484e488-0b54-492a-8187-4aea3f77b5c1]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:22 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16
Jun 01 02:05:22 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:22 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16" returned: 0 in 0.777s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:22 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:22 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16
Jun 01 02:05:22 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:23 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-9b2c857e-3462-4579-96a9-daefea2d7a16" returned: 0 in 0.637s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-9b2c857e-3462-4579-96a9-daefea2d7a16" released by "delete_volume" :: held 1.478s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created reservations ['418753f3-3b5f-4b40-9e58-ea2f66212b1e', 'c943ac8c-5b7d-4106-998f-4bf72a63a5ac', 'ba623d91-350d-4036-81cb-ae59e14bc4d8', 'a2d04ab9-ca00-48ed-baca-1d73b09e70c5'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:23 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:23 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:23 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-63528963-97a2-401d-af6a-6addfad45e86-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:24 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.624s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:24 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Deleted volume successfully.
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-63528963-97a2-401d-af6a-6addfad45e86-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-89a0dcf9-a5ed-48f5-bd3e-72292090c1c1 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-9b2c857e-3462-4579-96a9-daefea2d7a16-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-63528963-97a2-401d-af6a-6addfad45e86" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-63528963-97a2-401d-af6a-6addfad45e86" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c22c9-f330-461b-8bc9-288fdab030d7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:24 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:24 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86
Jun 01 02:05:24 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:25 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86" returned: 0 in 0.737s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:25 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86
Jun 01 02:05:25 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:25 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-63528963-97a2-401d-af6a-6addfad45e86" returned: 0 in 0.633s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-63528963-97a2-401d-af6a-6addfad45e86" released by "delete_volume" :: held 1.418s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created reservations ['f8b3ef1d-1b00-4d1d-a3b4-4a46839b972c', 'ad189e56-525c-40cd-99bd-03dd535619d7', '283b9ffc-3816-4fdd-af54-1bdb425985f1', 'e3ad0a6e-27ea-4983-9fa5-dfe0be79b611'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:25 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:26 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:26 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-bab052bd-58a9-40e2-b727-2579fdcd22d9-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-bab052bd-58a9-40e2-b727-2579fdcd22d9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:26 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.649s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:26 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Deleted volume successfully.
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-bab052bd-58a9-40e2-b727-2579fdcd22d9" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-f51cd2bc-389c-43e2-a76f-931be1d669f7 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-63528963-97a2-401d-af6a-6addfad45e86-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-bab052bd-58a9-40e2-b727-2579fdcd22d9" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3583d3-f553-402d-a88e-3b411fd4cc2e]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:26 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:26 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9
Jun 01 02:05:26 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:27 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9" returned: 0 in 0.755s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:27 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:27 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9
Jun 01 02:05:27 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:28 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-bab052bd-58a9-40e2-b727-2579fdcd22d9" returned: 0 in 0.604s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-bab052bd-58a9-40e2-b727-2579fdcd22d9" released by "delete_volume" :: held 1.402s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created reservations ['18514f45-31ee-4831-9782-53f761ffd1dc', 'acbb08a0-9f5f-47ee-ab26-cf6dde955d7f', '8f6bc089-5293-467c-ae21-ab4f7c2f8fdc', '671d480b-bffc-495d-bb52-121304d952e6'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:28 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:28 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-99aecb69-5796-4d97-aa39-d52ca9f64200-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-99aecb69-5796-4d97-aa39-d52ca9f64200-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:28 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.698s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:28 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Deleted volume successfully.
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-99aecb69-5796-4d97-aa39-d52ca9f64200" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-99aecb69-5796-4d97-aa39-d52ca9f64200" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-2ec59d24-8252-478d-b1ca-59a19eb9e527 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-bab052bd-58a9-40e2-b727-2579fdcd22d9-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d2d098-3330-47c4-ba0a-2a5c918d6190]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:28 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:29 devstack sudo[106160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200
Jun 01 02:05:29 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:29 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200" returned: 0 in 0.745s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:29 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:29 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200
Jun 01 02:05:29 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:30 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-99aecb69-5796-4d97-aa39-d52ca9f64200" returned: 0 in 0.617s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-99aecb69-5796-4d97-aa39-d52ca9f64200" released by "delete_volume" :: held 1.403s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created reservations ['96774190-2c3e-4180-999a-2d7878a8d306', '9ba29a5e-32c2-40d9-8a0b-846b67917689', '157db64d-1b25-4758-861f-0a97890ed51a', 'f1e59d82-d738-48e7-a747-d3fd6ef165c1'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:30 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:30 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:30 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-eeafe528-53ad-415f-a543-6e03783d98cd-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:31 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.648s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:31 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Deleted volume successfully.
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-eeafe528-53ad-415f-a543-6e03783d98cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-086ff288-4695-4668-bc17-8cb558837876" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9e7ce31-f14a-4e0b-ba50-38104341091c tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-99aecb69-5796-4d97-aa39-d52ca9f64200-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-086ff288-4695-4668-bc17-8cb558837876" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-eeafe528-53ad-415f-a543-6e03783d98cd" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-eeafe528-53ad-415f-a543-6e03783d98cd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Deleting offline snapshot eeafe528-53ad-415f-a543-6e03783d98cd of volume 086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] snapshot_file for this snap is: volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad15c84-b1fb-4991-a46e-2a0dfd5d3a1b]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:31 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd
Jun 01 02:05:31 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:31 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd" returned: 0 in 0.742s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:31 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086ff288-4695-4668-bc17-8cb558837876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 02:05:32 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[556e321e-3820-474a-b3ef-9b3433edcc14]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:32 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876
Jun 01 02:05:32 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:32 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876" returned: 0 in 0.743s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:32 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:32 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd
Jun 01 02:05:32 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:33 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd" returned: 0 in 0.714s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:33 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:33 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd
Jun 01 02:05:33 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:34 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876.eeafe528-53ad-415f-a543-6e03783d98cd" returned: 0 in 0.607s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-eeafe528-53ad-415f-a543-6e03783d98cd" released by "_delete_snapshot" :: held 2.936s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-086ff288-4695-4668-bc17-8cb558837876" released by "delete_snapshot" :: held 2.962s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created reservations ['b94a2b6c-eca5-45cd-895d-8b044bfe9178', '81ef7cb2-0f45-4d66-98f7-9bbd7d4b4488', 'c2f4950a-b9d2-4aca-b0ad-da2fd4b1801f', '6d9b8a13-826d-4e5e-9b93-7698251a9a3b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:34 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Delete snapshot completed successfully.
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-a85d431f-2637-4f3f-951d-6f4350ac7959 tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-eeafe528-53ad-415f-a543-6e03783d98cd-delete_snapshot" released by "delete_snapshot" :: held 3.139s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-086ff288-4695-4668-bc17-8cb558837876-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-086ff288-4695-4668-bc17-8cb558837876-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "cinder-quobyte-086ff288-4695-4668-bc17-8cb558837876" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-086ff288-4695-4668-bc17-8cb558837876" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d322e3a-f8a8-45a5-90dd-f06279541bdd]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:34 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:34 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876
Jun 01 02:05:34 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:35 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876" returned: 0 in 0.758s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:35 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876
Jun 01 02:05:35 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:35 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-086ff288-4695-4668-bc17-8cb558837876" returned: 0 in 0.615s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-quobyte-086ff288-4695-4668-bc17-8cb558837876" released by "delete_volume" :: held 1.437s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Flow 'volume_create_manager' (f97eb4e9-6717-4c15-a838-80afefdb8505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc594552-2389-4f30-9b31-ee44606214dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc594552-2389-4f30-9b31-ee44606214dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-822191230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cedbae-283b-424f-b0af-804f5c40cee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d0cd57dadc4464bf5dc242e6a2fefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:36Z,use_quota=True,user_id='c7517e5d9fef433f8d7cb8193de73a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb1d27-7ef2-49d3-8269-0e58cfa84b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb1d27-7ef2-49d3-8269-0e58cfa84b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49074e1a-5e04-4af0-9c5f-7fdb8692a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49074e1a-5e04-4af0-9c5f-7fdb8692a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cedbae-283b-424f-b0af-804f5c40cee6', 'volume_name': 'volume-d0cedbae-283b-424f-b0af-804f5c40cee6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3135a39-b972-4f81-8b58-c73ed0a79e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3135a39-b972-4f81-8b58-c73ed0a79e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0348a7-a125-4897-b075-912170b63355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:35 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Volume d0cedbae-283b-424f-b0af-804f5c40cee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cedbae-283b-424f-b0af-804f5c40cee6', 'volume_size': 1}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:35 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-822191230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cedbae-283b-424f-b0af-804f5c40cee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d0cd57dadc4464bf5dc242e6a2fefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:36Z,use_quota=True,user_id='c7517e5d9fef433f8d7cb8193de73a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Creating volume d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:36 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Created reservations ['57df7e00-730e-4892-9f0b-fb4ebe1c7d7b', '77ab2adf-ee5d-45cc-be80-442b8c8b4188', '7c66b41d-e3c1-4bae-b2f5-236ab9ee57bc', '4a156c32-73c6-4455-b395-654cfd8c1987'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:36 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 1073741824
Jun 01 02:05:36 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:36 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:36 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:36 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.626s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:36 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Deleted volume successfully.
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-0842e52c-c39b-4d4a-8f1a-81f716023d6e tempest-CreateVolumesFromSnapshotTest-1554687602 None] Lock "cinder-086ff288-4695-4668-bc17-8cb558837876-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:36 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 1073741824" returned: 0 in 0.854s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:36 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:36 devstack sudo[106208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6
Jun 01 02:05:36 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:37 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6" returned: 0 in 0.653s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:37 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:37 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0348a7-a125-4897-b075-912170b63355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cedbae-283b-424f-b0af-804f5c40cee6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893217fe-be35-4481-b0fb-8ff002518efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:37 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Volume volume-d0cedbae-283b-424f-b0af-804f5c40cee6 (d0cedbae-283b-424f-b0af-804f5c40cee6): created successfully
Jun 01 02:05:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893217fe-be35-4481-b0fb-8ff002518efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:37 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Flow 'volume_create_manager' (f97eb4e9-6717-4c15-a838-80afefdb8505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:37 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-8f1339cd-b9a2-4b23-8471-9b33591bcf36 tempest-SnapshotDependencyTests-680093625 None] Created volume successfully.
Jun 01 02:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:38 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Creating offline snapshot 5b6f5691-1839-4d2a-a43a-f7976ac51ae4 of volume d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 02:05:38 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[70330aba-ddf5-4944-9747-e467e5f7e973]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:38 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:38 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6
Jun 01 02:05:38 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:39 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6" returned: 0 in 0.799s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:39 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 1G
Jun 01 02:05:39 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Flow 'volume_create_manager' (440e0dc6-c9ef-476f-ab9a-c593ee616fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cb129a-9534-4d3b-8960-7ba4071aa0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cb129a-9534-4d3b-8960-7ba4071aa0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ebe5ad-ea04-4fec-9131-df2092df6bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff82da7658d402298a85dc504a1e508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:40Z,use_quota=True,user_id='19c7c332526f416d84db542f2f0a2392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1ca86-a640-4c48-a799-ff9e6677f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1ca86-a640-4c48-a799-ff9e6677f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00cd196-bf97-4113-8b0a-8b62bef5dd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00cd196-bf97-4113-8b0a-8b62bef5dd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ebe5ad-ea04-4fec-9131-df2092df6bb6', 'volume_name': 'volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a656cfb0-c558-476a-9cea-65c0636cac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a656cfb0-c558-476a-9cea-65c0636cac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31c0636-34dc-4ac2-bd68-3c65aa4eda1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:39 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Volume b9ebe5ad-ea04-4fec-9131-df2092df6bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6', 'volume_size': 1}
Jun 01 02:05:39 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:40 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 1G" returned: 0 in 0.826s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0cedbae-283b-424f-b0af-804f5c40cee6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:40 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0cedbae-283b-424f-b0af-804f5c40cee6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4
Jun 01 02:05:40 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:40 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0cedbae-283b-424f-b0af-804f5c40cee6 -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4" returned: 0 in 0.681s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:40 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 is being set with open permissions: ugo+rw
Jun 01 02:05:40 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:40 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4
Jun 01 02:05:40 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:41 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4" returned: 0 in 0.593s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:41 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.info
Jun 01 02:05:41 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:41 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.info" returned: 0 in 0.588s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:41 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.info is being set with open permissions: ugo+rw
Jun 01 02:05:41 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:41 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.info
Jun 01 02:05:41 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:42 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.info" returned: 0 in 0.579s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.157s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.857s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ebe5ad-ea04-4fec-9131-df2092df6bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff82da7658d402298a85dc504a1e508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:40Z,use_quota=True,user_id='19c7c332526f416d84db542f2f0a2392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Creating volume b9ebe5ad-ea04-4fec-9131-df2092df6bb6 {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:42 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:42 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:42 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6 1073741824
Jun 01 02:05:42 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:42 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-4338c7c1-e402-4d60-a390-f16b00761e87 tempest-SnapshotDependencyTests-680093625 None] Create snapshot completed successfully
Jun 01 02:05:43 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6 1073741824" returned: 0 in 0.769s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:43 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6
Jun 01 02:05:43 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:43 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6" returned: 0 in 0.600s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31c0636-34dc-4ac2-bd68-3c65aa4eda1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827a3cd4-3870-406b-afc6-59f88caf8e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:43 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Volume volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6 (b9ebe5ad-ea04-4fec-9131-df2092df6bb6): created successfully
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827a3cd4-3870-406b-afc6-59f88caf8e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:43 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Flow 'volume_create_manager' (440e0dc6-c9ef-476f-ab9a-c593ee616fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:43 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-db42af65-6fea-4766-982f-c32768d4b85c tempest-CinderUnicodeTest-2091346484 None] Created volume successfully.
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Flow 'volume_create_manager' (36daaae5-2dab-4fc6-82d0-d92805e82a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a4b7e9-90f6-40d4-9475-e22a0bff133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a4b7e9-90f6-40d4-9475-e22a0bff133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2bc0d8-fff0-453c-bddb-728af20137f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d0cd57dadc4464bf5dc242e6a2fefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b6f5691-1839-4d2a-a43a-f7976ac51ae4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:44Z,use_quota=True,user_id='c7517e5d9fef433f8d7cb8193de73a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95334b-85a3-4b84-a1dd-a034a823e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95334b-85a3-4b84-a1dd-a034a823e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af99ed6-2e63-4744-a607-b1ead12d1f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af99ed6-2e63-4744-a607-b1ead12d1f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a2bc0d8-fff0-453c-bddb-728af20137f6', 'volume_name': 'volume-0a2bc0d8-fff0-453c-bddb-728af20137f6', 'volume_size': 1, 'snapshot_id': '5b6f5691-1839-4d2a-a43a-f7976ac51ae4'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85ff41d-542f-4089-980d-52eebe5fe051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85ff41d-542f-4089-980d-52eebe5fe051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64e8c01-81c3-47b4-84c7-e2d3d53b5bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:44 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Volume 0a2bc0d8-fff0-453c-bddb-728af20137f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a2bc0d8-fff0-453c-bddb-728af20137f6', 'volume_size': 1, 'snapshot_id': '5b6f5691-1839-4d2a-a43a-f7976ac51ae4'}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-quobyte-5b6f5691-1839-4d2a-a43a-f7976ac51ae4-0a2bc0d8-fff0-453c-bddb-728af20137f6" by "_create_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-5b6f5691-1839-4d2a-a43a-f7976ac51ae4-0a2bc0d8-fff0-453c-bddb-728af20137f6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Creating volume 0a2bc0d8-fff0-453c-bddb-728af20137f6 from snapshot 5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-quobyte-0a2bc0d8-fff0-453c-bddb-728af20137f6" by "_copy_volume_from_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-0a2bc0d8-fff0-453c-bddb-728af20137f6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] snapshot: 5b6f5691-1839-4d2a-a43a-f7976ac51ae4, volume: 0a2bc0d8-fff0-453c-bddb-728af20137f6,  {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d7b638-80dd-493d-8fc2-8399266b4b55]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:44 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4
Jun 01 02:05:44 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:44 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4" returned: 0 in 0.702s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0cedbae-283b-424f-b0af-804f5c40cee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Creating direct copy from snapshot {{(pid=86676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5889b2c9-8f9b-422e-9070-848ab649a3c6]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:44 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:45 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6
Jun 01 02:05:45 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.flows.manager.create_volume [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Flow 'volume_create_manager' (307118bd-24ca-494e-84d2-5753e504b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55425eb-fafc-4b3c-bde8-f691aac2e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55425eb-fafc-4b3c-bde8-f691aac2e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-85326754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff976b8-1088-4929-b948-c8d04398ee8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff82da7658d402298a85dc504a1e508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:45Z,use_quota=True,user_id='19c7c332526f416d84db542f2f0a2392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88114a9f-e8e4-420b-ad94-2988763191ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88114a9f-e8e4-420b-ad94-2988763191ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5f23d6-c0e1-474b-aaef-8210d31f3e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5f23d6-c0e1-474b-aaef-8210d31f3e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff976b8-1088-4929-b948-c8d04398ee8a', 'volume_name': 'volume-7ff976b8-1088-4929-b948-c8d04398ee8a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffa14eb-196d-46ef-af83-0463c44e00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffa14eb-196d-46ef-af83-0463c44e00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03dd1d7-765a-48ab-8119-d4ba96e0de10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:45 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Volume 7ff976b8-1088-4929-b948-c8d04398ee8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff976b8-1088-4929-b948-c8d04398ee8a', 'volume_size': 1}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:45 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6" returned: 0 in 0.743s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG cinder.utils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Path /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 not found in is_blk_device check {{(pid=86676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 01 02:05:45 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:45 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6
Jun 01 02:05:45 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:50 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6" returned: 0 in 4.455s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:50 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd894029-9133-462f-9c21-41febb4ecbae]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:50 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:50 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6
Jun 01 02:05:50 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:51 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6" returned: 0 in 0.867s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.image.image_utils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Image conversion details: src /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 {{(pid=86676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 01 02:05:51 devstack cinder-volume[86676]: INFO cinder.image.image_utils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Converted 1024.00 MB image at 229.76 MB/s
Jun 01 02:05:51 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 is being set with open permissions: ugo+rw
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:51 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6
Jun 01 02:05:51 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:51 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6" returned: 0 in 0.604s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-0a2bc0d8-fff0-453c-bddb-728af20137f6" released by "_copy_volume_from_snapshot" :: held 7.459s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-5b6f5691-1839-4d2a-a43a-f7976ac51ae4-0a2bc0d8-fff0-453c-bddb-728af20137f6" released by "_create_volume_from_snapshot" :: held 7.488s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.503s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.250s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x728655f7ec00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-01T00:05:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-85326754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff976b8-1088-4929-b948-c8d04398ee8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff82da7658d402298a85dc504a1e508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-01T00:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-01T00:05:45Z,use_quota=True,user_id='19c7c332526f416d84db542f2f0a2392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfcf6ab6-480f-46a2-9220-2acd44491591),volume_type_id=cfcf6ab6-480f-46a2-9220-2acd44491591)}" {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Creating volume 7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Selected osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4 as target Quobyte volume. {{(pid=86676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 01 02:05:51 devstack cinder-volume[86676]: INFO cinder.volume.drivers.remotefs [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] casted to osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a 1073741824 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:51 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a 1073741824
Jun 01 02:05:51 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64e8c01-81c3-47b4-84c7-e2d3d53b5bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2bc0d8-fff0-453c-bddb-728af20137f6', 'volume_size': 1, 'snapshot_id': '5b6f5691-1839-4d2a-a43a-f7976ac51ae4'}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecafc366-4e03-4d64-b5ef-82521f005823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:51 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Volume volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 (0a2bc0d8-fff0-453c-bddb-728af20137f6): created successfully
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecafc366-4e03-4d64-b5ef-82521f005823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:51 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Flow 'volume_create_manager' (36daaae5-2dab-4fc6-82d0-d92805e82a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:51 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-96c3333e-3194-496e-8c1e-e0dcf3ac38da tempest-SnapshotDependencyTests-680093625 None] Created volume successfully.
Jun 01 02:05:52 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a 1073741824" returned: 0 in 0.751s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:SELECT=116,cinder:INSERT=51,cinder:UPDATE=172,cinder:DELETE=12 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:52 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:52 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:52 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a
Jun 01 02:05:52 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-5b6f5691-1839-4d2a-a43a-f7976ac51ae4-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-5b6f5691-1839-4d2a-a43a-f7976ac51ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-quobyte-d0cedbae-283b-424f-b0af-804f5c40cee6" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-d0cedbae-283b-424f-b0af-804f5c40cee6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-quobyte-5b6f5691-1839-4d2a-a43a-f7976ac51ae4" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-5b6f5691-1839-4d2a-a43a-f7976ac51ae4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Deleting offline snapshot 5b6f5691-1839-4d2a-a43a-f7976ac51ae4 of volume d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] snapshot_file for this snap is: volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[be35b9d9-0327-4af4-905f-1f385f69a457]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:52 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:53 devstack sudo[106290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4
Jun 01 02:05:53 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:53 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a" returned: 0 in 0.614s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'} {{(pid=86676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03dd1d7-765a-48ab-8119-d4ba96e0de10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff976b8-1088-4929-b948-c8d04398ee8a', 'volume_size': 1}' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:53 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3e322c-5cd7-47b6-ae85-ddab157c207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.663s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG oslo_service.periodic_task [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] Running periodic task VolumeManager._thread_info {{(pid=86676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread count: 28 {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-9cbe2639-3d2d-4c98-a11e-b3d611b33a59 None None] thread info: [<_MainThread(MainThread, started 125921402941568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125921295628736)>, <Thread(Thread-3 (stat_writer), started daemon 125921293150720)>, <Thread(Rabbit-heartbeat, started daemon 125921294308544)>, <Thread(Thread-5 (_runner), started daemon 125921291861632)>, <Thread(Thread-7 (_runner), started daemon 125921292124480)>, <Thread(fd_logger, started daemon 125921288069120)>, <Thread(privsep_reader, started daemon 125921289640256)>, <Thread(tpool_thread_0, started daemon 125921281689280)>, <Thread(tpool_thread_1, started daemon 125921273296576)>, <Thread(tpool_thread_2, started daemon 125921264903872)>, <Thread(tpool_thread_3, started daemon 125921256511168)>, <Thread(tpool_thread_4, started daemon 125921248118464)>, <Thread(tpool_thread_5, started daemon 125921239725760)>, <Thread(tpool_thread_6, started daemon 125921231333056)>, <Thread(tpool_thread_7, started daemon 125921222940352)>, <Thread(tpool_thread_8, started daemon 125921214547648)>, <Thread(tpool_thread_9, started daemon 125921206154944)>, <Thread(tpool_thread_10, started daemon 125921197762240)>, <Thread(tpool_thread_11, started daemon 125921189369536)>, <Thread(tpool_thread_12, started daemon 125921180976832)>, <Thread(tpool_thread_13, started daemon 125921172584128)>, <Thread(tpool_thread_14, started daemon 125921164191424)>, <Thread(tpool_thread_15, started daemon 125921155798720)>, <Thread(tpool_thread_16, started daemon 125921147406016)>, <Thread(tpool_thread_17, started daemon 125921139013312)>, <Thread(tpool_thread_18, started daemon 125921130620608)>, <Thread(tpool_thread_19, started daemon 125921122227904)>] {{(pid=86676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 01 02:05:53 devstack cinder-volume[86676]: INFO cinder.volume.flows.manager.create_volume [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Volume volume-7ff976b8-1088-4929-b948-c8d04398ee8a (7ff976b8-1088-4929-b948-c8d04398ee8a): created successfully
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3e322c-5cd7-47b6-ae85-ddab157c207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Flow 'volume_create_manager' (307118bd-24ca-494e-84d2-5753e504b834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 01 02:05:53 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-362a12b8-946f-491d-8ea8-e77b2b88a7be tempest-CinderUnicodeTest-2091346484 None] Created volume successfully.
Jun 01 02:05:53 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4" returned: 0 in 0.692s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0cedbae-283b-424f-b0af-804f5c40cee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c58d8-c4e2-447c-a19c-802ed31fd8aa]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:53 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:53 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6
Jun 01 02:05:53 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Creating offline snapshot c7ec31ef-b774-4c2a-8c4b-780f65b580b1 of volume 7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd15ea-e183-4347-9f41-cf4b220398fc]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:54 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6" returned: 0 in 0.716s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:54 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a
Jun 01 02:05:54 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:54 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4
Jun 01 02:05:54 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:54 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a" returned: 0 in 0.715s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:54 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 1G {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:55 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 1G
Jun 01 02:05:55 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:55 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4" returned: 0 in 0.694s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:55 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4
Jun 01 02:05:55 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:55 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6.5b6f5691-1839-4d2a-a43a-f7976ac51ae4" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:55 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 1G" returned: 0 in 0.716s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff976b8-1088-4929-b948-c8d04398ee8a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-5b6f5691-1839-4d2a-a43a-f7976ac51ae4" released by "_delete_snapshot" :: held 2.827s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-d0cedbae-283b-424f-b0af-804f5c40cee6" released by "delete_snapshot" :: held 2.869s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:55 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff976b8-1088-4929-b948-c8d04398ee8a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1
Jun 01 02:05:55 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Created reservations ['ac822286-092c-49b4-87f7-03b9c81dfbf6', '83c9c5a9-4b80-424d-a9e2-b97f2681a229', 'd8048c7f-5f6f-478c-b90d-312f262fda92', '7291bd6e-00e3-4313-9e5c-5c7140a8c6ac'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:55 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Delete snapshot completed successfully.
Jun 01 02:05:55 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-d9ea933f-1830-4425-976f-82d192f32f13 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-5b6f5691-1839-4d2a-a43a-f7976ac51ae4-delete_snapshot" released by "delete_snapshot" :: held 3.005s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-d0cedbae-283b-424f-b0af-804f5c40cee6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-d0cedbae-283b-424f-b0af-804f5c40cee6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-quobyte-d0cedbae-283b-424f-b0af-804f5c40cee6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-d0cedbae-283b-424f-b0af-804f5c40cee6" acquired by "delete_volume" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b294c-0c5e-4389-b944-24bb056ee163]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:56 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6
Jun 01 02:05:56 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:56 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff976b8-1088-4929-b948-c8d04398ee8a -F qcow2 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1" returned: 0 in 0.682s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:56 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 is being set with open permissions: ugo+rw
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:56 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1
Jun 01 02:05:56 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:56 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6" returned: 0 in 0.736s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:56 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6
Jun 01 02:05:56 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:56 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:56 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1" returned: 0 in 0.589s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:57 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.info
Jun 01 02:05:57 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:57 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-d0cedbae-283b-424f-b0af-804f5c40cee6" returned: 0 in 0.610s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-d0cedbae-283b-424f-b0af-804f5c40cee6" released by "delete_volume" :: held 1.401s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Created reservations ['6c628e08-46c4-4385-8333-5188da107d7c', 'b0b64f80-e053-48f9-bc23-ae0ab4aa5a7d', '49db8732-d286-4298-9f36-651e0efe492e', '13c6c3b8-d9fb-48a2-b2ba-a293cfc5869b'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:57 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:57 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:57 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.info" returned: 0 in 0.632s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:57 devstack cinder-volume[86676]: WARNING cinder.volume.drivers.remotefs [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.info is being set with open permissions: ugo+rw
Jun 01 02:05:57 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.info {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:57 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.info
Jun 01 02:05:57 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:58 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.630s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:05:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Deleted volume successfully.
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-0a2bc0d8-fff0-453c-bddb-728af20137f6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-0a2bc0d8-fff0-453c-bddb-728af20137f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-1d64542a-4815-4c93-8e34-713e9cdcae7e tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-d0cedbae-283b-424f-b0af-804f5c40cee6-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:58 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.info" returned: 0 in 0.646s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.068s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "cinder-quobyte-0a2bc0d8-fff0-453c-bddb-728af20137f6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:58 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-d7b0063c-5efa-49fa-8aa2-32fc996f322d tempest-CinderUnicodeTest-2091346484 None] Create snapshot completed successfully
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-0a2bc0d8-fff0-453c-bddb-728af20137f6" acquired by "delete_volume" :: waited 0.016s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e61315-2988-44e9-bf8b-ef6c8a754f47]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:58 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:58 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6
Jun 01 02:05:58 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:59 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6" returned: 0 in 0.710s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:59 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6
Jun 01 02:05:59 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "cinder-c7ec31ef-b774-4c2a-8c4b-780f65b580b1-delete_snapshot" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-c7ec31ef-b774-4c2a-8c4b-780f65b580b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "cinder-quobyte-7ff976b8-1088-4929-b948-c8d04398ee8a" by "delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-7ff976b8-1088-4929-b948-c8d04398ee8a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "cinder-quobyte-c7ec31ef-b774-4c2a-8c4b-780f65b580b1" by "_delete_snapshot" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-c7ec31ef-b774-4c2a-8c4b-780f65b580b1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Deleting offline snapshot c7ec31ef-b774-4c2a-8c4b-780f65b580b1 of volume 7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] snapshot_file for this snap is: volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 {{(pid=86676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4863ff6-dc5a-4861-a61a-1d2847c85db0]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:59 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1
Jun 01 02:05:59 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:05:59 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-0a2bc0d8-fff0-453c-bddb-728af20137f6" returned: 0 in 0.616s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-quobyte-0a2bc0d8-fff0-453c-bddb-728af20137f6" released by "delete_volume" :: held 1.365s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Created reservations ['61a32772-e744-42f8-b7ee-0a7dfe6786b6', '2a3ffec0-c589-4fee-8763-a91211086432', '6c4583a6-5480-4827-92ce-816ca5c313bd', '703a2cea-de5e-4f06-8d14-22ecb891aa82'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:05:59 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:05:59 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:05:59 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:00 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1" returned: 0 in 0.713s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.remotefs [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff976b8-1088-4929-b948-c8d04398ee8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7aa253-f7f1-4f93-b79c-c06bdaa0ca35]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:00 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a
Jun 01 02:06:00 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:00 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.601s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:06:00 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Deleted volume successfully.
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-359a430a-895a-4c5c-ba4b-600f39621e89 tempest-SnapshotDependencyTests-680093625 None] Lock "cinder-0a2bc0d8-fff0-453c-bddb-728af20137f6-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:00 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:00 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a" returned: 0 in 0.707s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:01 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1
Jun 01 02:06:01 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:01 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1" returned: 0 in 0.749s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:01 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:01 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1
Jun 01 02:06:01 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:02 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a.c7ec31ef-b774-4c2a-8c4b-780f65b580b1" returned: 0 in 0.635s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-c7ec31ef-b774-4c2a-8c4b-780f65b580b1" released by "_delete_snapshot" :: held 2.902s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-7ff976b8-1088-4929-b948-c8d04398ee8a" released by "delete_snapshot" :: held 2.925s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Created reservations ['89afbdd1-5d79-4d02-a8ed-c354b049b0cc', 'c43c6532-3128-41bd-900b-ce164f4446b6', '1af01eeb-c2ab-404d-a25a-451d506456b6', '5afd8b49-8a05-40d6-8ac4-c1d714d5199c'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:06:02 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Delete snapshot completed successfully.
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-aae35188-838e-4647-90d9-6a0e7721cb5f tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-c7ec31ef-b774-4c2a-8c4b-780f65b580b1-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "cinder-7ff976b8-1088-4929-b948-c8d04398ee8a-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-7ff976b8-1088-4929-b948-c8d04398ee8a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "cinder-quobyte-7ff976b8-1088-4929-b948-c8d04398ee8a" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-7ff976b8-1088-4929-b948-c8d04398ee8a" acquired by "delete_volume" :: waited 0.017s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26d136d-3010-4fe2-a4b9-923b3ae5f6f2]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:06:02 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:02 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a
Jun 01 02:06:02 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:03 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a" returned: 0 in 0.753s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:03 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:03 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a
Jun 01 02:06:03 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:04 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-7ff976b8-1088-4929-b948-c8d04398ee8a" returned: 0 in 0.622s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-7ff976b8-1088-4929-b948-c8d04398ee8a" released by "delete_volume" :: held 1.456s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Created reservations ['fbc70def-f75d-4b45-8df1-23e31d6eddec', '4f81a970-5266-4180-b322-f32ef34eb3e8', '3097f229-a80c-456c-b16f-67bec9a50ad8', 'd0c02c8b-16f2-407e-acf8-576cd34103cb'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:04 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:06:04 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "cinder-b9ebe5ad-ea04-4fec-9131-df2092df6bb6-delete_volume" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-b9ebe5ad-ea04-4fec-9131-df2092df6bb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:06:04 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.641s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:06:04 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "cinder-quobyte-b9ebe5ad-ea04-4fec-9131-df2092df6bb6" by "delete_volume" {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 01 02:06:04 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Deleted volume successfully.
Jun 01 02:06:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-b9ebe5ad-ea04-4fec-9131-df2092df6bb6" acquired by "delete_volume" :: waited 0.020s {{(pid=86676) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 01 02:06:05 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-e9e0b5c9-a5f1-4d0b-a5c6-1bfe1974cba6 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-7ff976b8-1088-4929-b948-c8d04398ee8a-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:05 devstack cinder-volume[86676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304c56b-87ec-4d49-bfc0-f84807c914a7]: (4, 'qcow2') {{(pid=87811) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 01 02:06:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:05 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6
Jun 01 02:06:05 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:05 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6" returned: 0 in 0.729s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:05 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:05 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6
Jun 01 02:06:05 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:06 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641/volume-b9ebe5ad-ea04-4fec-9131-df2092df6bb6" returned: 0 in 0.613s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-quobyte-b9ebe5ad-ea04-4fec-9131-df2092df6bb6" released by "delete_volume" :: held 1.392s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG cinder.quota [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Created reservations ['09365645-a886-41f5-b0ad-a19405eb37bf', '6cfb5682-e194-4bc5-bedf-74683ac34639', 'bb491829-43ec-4ebb-ae79-6e0c5a97f123', 'c15287d0-e54e-469d-99d7-1ceef22202e2'] {{(pid=86676) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4': None} {{(pid=86676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG cinder.volume.drivers.quobyte [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f8fb0af3-7dc3-4284-8801-d5e2adba38c4'] {{(pid=86676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.lockutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 01 02:06:06 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641 {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 01 02:06:06 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641
Jun 01 02:06:06 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 01 02:06:07 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Jun 01 02:06:07 devstack cinder-volume[86676]: DEBUG oslo_concurrency.processutils [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/403493df319144df343999f94008f641" returned: 0 in 0.663s {{(pid=86676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 01 02:06:07 devstack cinder-volume[86676]: DEBUG cinder.manager [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Notifying Schedulers of capabilities ... {{(pid=86676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 01 02:06:07 devstack cinder-volume[86676]: INFO cinder.volume.manager [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Deleted volume successfully.
Jun 01 02:06:07 devstack cinder-volume[86676]: DEBUG cinder.coordination [None req-5e61aedf-0c1b-4da2-92bd-134a00985121 tempest-CinderUnicodeTest-2091346484 None] Lock "cinder-b9ebe5ad-ea04-4fec-9131-df2092df6bb6-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=86676) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 01 02:06:16 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=45,cinder:DELETE=4,cinder:SELECT=37,cinder:INSERT=13 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 01 02:06:17 devstack cinder-volume[86676]: DEBUG dbcounter [-] [86676] Writing DB stats cinder:UPDATE=142,cinder:INSERT=36,cinder:SELECT=109,cinder:DELETE=12 {{(pid=86676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}